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ABSTRACT 


We  discuss  a single  server  queue  whose  Input  Is  the 
versatile  Markovian  point  process  recently  Introduced  by 
M.  F.  Neuts  (c.f.  Tech  Report  #77/13,  Dept,  of  Statistics  & 
CS,  Univ.  of  Delaware),  herein  to  be  called  the  N-Process . 
Special  cases  of  the  N-Process  discussed  earlier  In  the 
literature  Include  a number  of  complex  models  such  as  the 
Markov-modulated  Poisson  Process,  the  superposition  of  a 
Poisson  Process  and  a Phase  Type  Renewal  Process  etc.  This 
queueing  model  has  great  appeal  In  Its  applicability  to  real 
world  situations  especially  such  as  those  Involving  Inhibi- 
tion or  stimulation  of  arrivals  by  certain  renewals.  The 
paper  presents  formulas  In  forms  which  are  computationally 
tractable  and  provides  a unified  treatment  of  many  models 
which  were  discussed  earlier  by  several  authors  and  which 
turn  out  to  be  special  cases.  Among  the  topics  discussed  are 
busy  period  characteristics,  queue  length  distributions, 
moments  of  the  queue  length  and  virtual  waiting  time.  The 
analysis  presented  here  serves  as  an  example  of  the  power  of 
Markov  Renewal  Theory. 
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CHAPTER  I 

THE  N-PROCESS  AND  THE  N/G/1  QUEUE 

1.1  Introduction 

In  this  Chapter  we  discuss  a versatile  class  of  point 
processes  on  the  real  line  which  are  closely  related  to 
finite-state  Markov  processes  and  indicate  how  a substantial 
number  of  models  hitherto  used  in  the  literature  for  modeling 
arrival  processes  are  particular  cases.  This  process  was 
recently  introduced  by  M.  F.  Neuts  [22],  and  we  shall  hence- 
forth refer  to  it  as  an  N-Process.  Herein  we  also  define 
the  N/G/1  queue  which  is  the  subject  matter  of  this  paper. 

Section  1.2  discusses  probability  distributions  of 
Phase  Type  (PH-Distributions ) and  Phase  Type  Renewal  Processes 
(PH-Renewal  Processes)  which  were  also  introduced  by  Neuts 
[14,20]  and  which  form  the  sub-strata  for  the  definition  of 
the  N-Process.  In  Section  1.3  we  define  the  N-Process  and 
summarize  some  useful  results  regarding  such  a process. 

In  Section  1.4  we  define  the  N/G/1  queueing  model  and 
describe  the  semi-Markov  sequence  imbedded  therein.  Finally, 
the  last  section  provides  a number  of  interesting  special 
cases  of  the  N/G/1  model  some  of  which  have  been  previously 
discussed. 
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1.2  Phase  Type  Distributions  and  Phase  Type  Renewal 
Processes 

Although  the  phase  concept  has  been  used  extensively  in 
the  literature  since  its  introduction  by  A.  K.  Erlang  [5], 
the  use  of  general  phase  distributions  has  remained  limited 
until  recently.  The  simplest  distributions  of  phase  type  due 
to  Erlang  and  bearing  his  name  have  been  generalized  by  some 
authors  [3,9]  by  considering  mixtures  of  them,  different 
parameters  for  different  phases,  random  number  of  phases  etc. 

A systematic  discussion  of  the  general  phase  concept  and  the 
accruing  benefits  in  modeling  a wide  variety  of  interesting 
qualitative  features  especially  of  interest  in  Queueing  Theory 
are  due  to  Neuts  [14]  who  has  also  demonstrated  the  power  of 
the  method  of  phases  in  a series  of  papers  [15,16,17].  We 
refer  the  reader  to  the  cited  references  for  a complete 
discussion  of  Phase  Type  distributions  and  their  usefulness, 
giving  only  a summary  of  those  results  pertinent  to  our 
discussion. 

Consider  a conti nuous-time  Markov  Process  with  state- 
space  {1 , . . . ,m,m+l } for  which  the  states  l,...,m  are  transient 
and  the  state  m+1  is  absorbing.  We  assume  that  starting  at 
any  transient  state,  absorption  into  m+1  is  almost  certain. 

The  Infinitesimal  generator  Q of  such  a Markov  Process  then 
has  the  form 

0 ' [o  0 ] • 

where  T is  an  mxm  matrix  with  T..<0  and  T.  .^0  for  i^j  such 


that  T~^  exists.  The  vector  T°  is  nonnegative  and  satisfies 

T(B+T*=£,  where  e=(l 1)'.  A vector  (a,  ^ ) of  initial 

probabilities  is  also  given  and  satisfies  “e+a^+1  = l»  ®=“ni+i‘'^* 

For  the  above  Markov  Process,  the  probability  distribu- 
tion F(«)  of  the  time  till  absorption  in  the  state  (m+1 ) is 
given  by 

F(x)  = 1-a  exp(Tx)£,  x>0  (1.2.2) 

Definition  1.2.3:  Any  probability  distribution  F(*)  on  [0,«») 
constructed  as  above  will  be  called  a Phase  Type  Distribution 
(PH-Distribution) . The  pair  (a,T)  will  be  called  a represen- 
tation of  F( • ) • 

In  the  sequel  we  shall  assume  that  = 0 so  that  F(*) 

does  not  have  an  atom  at  0.  In  [14]  it  is  shown  that  one  may, 
without  loss  of  generality,  assume  that  the  representation 
(a,T)  of  F(«)  is  so  chosen  that  the  matrix 

Q*  = T+T°A°,  (1.2.4) 

where  T°  is  an  mxm  matrix  all  whose  columns  are  T°  and 
A“  = diag(oi^ , . . . ,a^) , is  irreducible.  Henceforth  we  assume 
that  this  is  indeed  the  case. 

The  matrix  Q*,  which  is  of  considerable  importance,  is 
the  infinitesimal  generator  of  the  Phase  Type  Renewal  Process 
(PH-Renewal  Process)  which  is  obtained  by  restarting  the 
Markov  Process  Q instantaneously  after  each  absorption 
(renewal)  by  performing  a multinomial  trial  with  probabilities 
o and  outcomes  l,...,m.  Note  that  the  times  between 
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1 


successive  renewals  of  such  a renewal  process  is  the 


PH-Distribution  F(*)  described  above  thereby  suggesting  its 
nomenclature . 


I 
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For  later  use  we  also  Introduce  the  following  notations. 
£will  denote  the  invariant  probability  vector  of  the  Markov 
Process  Q*,  i.e.,  the  unique  (strictly  positive)  vector 
satisfyi ng 


0Q*  = 0,  ee  = 1 . (1.2.5) 

We  recall  from  [20]  that  the  stationary  version  of  the  PH- 
Renewal  Process  is  obtained  by  starting  the  Markov  Process  Q* 
with  initial  probability  vector  We  also  recall  that  the 
mean  of  F(*)  is  given  by 


P]  = -aT'^e.  (1.2.6) 

It  is  now  easily  verified  that 

6 = K (-aT“b.  (1.2.7) 

- P]  - 

In  the  sequel  A°®  will  denote  an  mxm  matrix  all  whose  rows  are 
a.  Also  the  mxm  matrix  each  of  whose  rows  is  ^ will  be 
denoted  by  0. 


1 . 3 The  N-Process 

The  Markov  Process  Q*  described  in  Section  1.2  will  be 
the  sub-stratum  for  the  definition  of  the  N-Process.  A 
transition  in  the  Markov  Process  Q*  from  the  state  i to  the 
state  j will  be  called  an  ( i , j ) - transi ti on  if  it  does  not 
involve  a renewal  (i.e.,  no  visit  to  the  "instantaneous" 
state  (m+1)),  and  an  ( i , j )-renewal  transition  otherwise. 

Note  that  unlike  the  former,  the  latter  may  go  from  a state 
to  itself.  We  are  now  ready  to  describe  the  arrival  process 


of  interest  in  terms  of  the  following  assumptions. 


Assumptions  regarding  arrival  epochs  and  group  sizes 

(A)  During  any  sojourn  of  the  Markov  Process  Q*  in  the  state 
i,  l<i<m,  there  are  Poisson  arrivals  of  rate  and  group 
size  density  {p^-(k):  k>0}.  We  let  (|i^(z)  denote  the  p.g.f.  of 
{p.(k)}  and  let  i(z)=((ti^  (z)  , . . . ,4)^(z) ) . 

(B)  At  (i ,j )-renewal  transitions  there  are  group  arrivals 
with  probability  density  {r..(k):  k>0}  whose  p.g.f.  is  ♦..(z). 

I J “ I J 

Let  t(z)  denote  the  m^m  matrix  of  entries  $^j(z). 

(C)  At  ( i , j )-transi  tions  , ij^j,  there  are  group  arrivals  with 
probability  density  {qj^(k):  k>0}  whose  p.g.f.  is  tj;..(z). 

For  notational  convenience  in  the  sequel  we  set  (z)  = l , 

l<i<m  and  let  t|)(z)  denote  the  mxm  matrix  of  entries  <j/..(z). 

" I J 

Independence  Assumptions 

(D)  For  every  t>0,  given  the  path  function  of  the  Markov 
Process  Q*  the  epochs  of  the  Type  A arrivals  are  conditionally 
independent  given  the  successive  sojourn  times,  and  behave  as 

a homogeneous  Poisson  process  on  every  sojourn  interval. 

(E)  Given  the  times  and  types  of  the  arrival  epochs  up  to 
time  t,  the  group  sizes  are  conditionally  independent  and 
have  the  probability  densities  given  above. 

Def i ni ti on  1.3.1:  The  arrival  process  defined  by  the  fore- 
going assumptions  (A)-(E)  is  called  an  N-Process . 

Let  N(t)  and  J(t),  t>0,  denote  respectively  the  number 
of  arrivals  in  (0,t]  and  the  state  of  the  Markov  Process  Q* 


at  t+.  (J(t)  will  be  referred  to  as  the  phase  at  t).  It  1s 

then  easy  to  see  that  { (N(t)  ,J (t) ) : t>0}  is  a Markov  Process 
with  state-space  {0 ,1  , . . . }x{ 1 , . . . .m} . 

In  [22]  it  is  shown  that  the  mxm  matrices  of  probabili- 
ties P( v,t)  = (P . . ( V ,t ) ) , v>0,  t>0,  where 

I J — 

P^.j(v,t)  = P{N(t)  = v.J(t)=j  |N(0)  = 0,J{0)  = i },  (1.3.2) 

have  generating  function 

00 

P(z,t)=  Z z'*P(v,t)  = exp[R(z)t],  |z|<l,  (1.3.3) 

v=0 

wi  th 

R(z)  = A(X)A(i(z))-A(x)+To«|/(z)+T'’A°o*(z),  (1.3.4) 

where 

A(x)  = diag(x^ Xj^),  (1.3.5) 

and 

A(i(z)  ) = diag(t^  (z) ,. . . ,(|)jj^(z)) , (1.3.6) 

and  'o'  here  and  in  the  sequel  denotes  the  Schur  product 
(entrywise  product)  of  two  matrices.  Further  it  is  shown 
that  the  matrix 


M(t) 


P(z 


.t)j 


z=l- 


is  given  by 

“ n-1  „ , 

M(t)  = r ^ z Q*''  R'(i) 
n=1  v=0 

where 

R'  (1 ) = a(Xox)+ToC+T‘'A“oD, 


(1.3.7) 


(1.3.8) 


(1.3.9) 


wi  th 


X=i'(l-),  C = ,|;'(1-),  D = $'(l-) 
A ~ ^i3g(XiYi  »•  • • 

Also  the  vector 

^(t)  = M(t)e, 


(1  .3.10) 

(1.3.11) 

(1.3.12) 


whose  j-th  component  is  the  expected  number  of  arrivals  in 
(0,t]  given  J(0)=j  is  given  by 

^(t)=5*te+(I-0)(T*0-Q*)"^R' (1 )e  + 

[0-exp(Q*t)](T*0-Q*)"^R'  (De.  (1.3.13) 

where 

C*  = eR' (1 )e  (1.3.14) 

and  T*  is  any  real  number  such  that  T*>max ( -Q’J . ) . We  also 

" i 

recall  that  c*  is  the  arrival  rate  for  the  stationary  version 
of  the  N-Process  which  is  obtained  by  starting  the  underlying 
Markov  Process  Q*  according  to 

The  following  theorem  gives  an  interesting  interpreta- 
tion for  the  quantity  5*  which  will  be  useful  later. 


Theorem  1.3.15:  5*  is  the  ratio  of  the  expected  number  of 

arrivals  during  a typical  renewal  interval  of  the  underlying 
PH-renewal  process  to  the  expected  length  of  that  renewal 
i nterva 1 . 


Proof : Let  , N2.  denote  respectively  the  number  of 
arrivals  of  types  (A),  (B)  and  (C)  (described  in  the  defini- 
tion of  the  N-Process)  during  a typical  renewal  interval. 

It  is  easily  seen  that 


00 


E(N,)  = I f [a  exp(Tx)].X.Yidx=-aT  A(^ox)e, 

I j Q_  J J J 

E(N,)  = E Z / [a  exp(Tx)]  .T°oi.  D,.  dx=-oT"^  (T“A°oD)e, 

^ j k 0-  J J K JK 


“ 1 
E(N3)  = E z / [a  exp(Tx)]jTj|^Cj.|^dx=-aT  '(ToC)e. 

J k 0“ 


Adding  the  above  three  quantities  and  dividing  by  wj,  we 
have,  by  (1.2.6),  (1.2.7)  and  (1.3.9)  that 


1 


E(N,+N2*N3)‘‘i'*'(')e=5*, 


and  hence  the  result. 


Remark : In  view  of  the  above  theorem  we  may  consider  5*  as  a 
"generalized"  arrival  rate  for  the  N-Process. 

We  now  present  some  results  concerning  the  matrix 

R(0)  = A(X_)A(i(0)  )-A(X)+Toi^(0)+T°A°o<I>(0) 

which  are  somewhat  technical  in  nature  and  which  will  be 
found  necessary  for  the  sequel.  Before  we  do  this,  let  us 
recall  [12]  the  following  regarding  Stability  matrices. 

Definition  1.3.16:  An  mxm  matrix  A of  complex  numbers  is 
said  to  be  semi -stabl e if  Re(6^.)<0  for  every  eigenvalue  6^  of 
A.  It  is  stable  if  Re(6^.  )<0  for  every  i. 

Lemma  1.3.17:  [12]:  If  A=(a..)  is  an  mxm  real  matrix, 

for  i3<j,  and  there  exist  positive  numbers  t,,...,t  such  that 

I m 

^ ^j®i j=0»  i = l , . . . ,m, 
then  A is  semi-stable. 


We  are  now  ready  to  prove 


Theorem  1.3.18;  The  matrix  R(o)  Is  semi-stable. 

Proof : By  comparing  R(o)  with  Q*  one  can  easily  show  that 

for  all  i,  R.^(0)<0  and  E Rj^(0)i0.  Since  R.-(0)>0  for  all 

i^'j  as  is  seen  directly,  R(0)  satisfies  the  conditions  of 

Lemma  1,3.17  with  ti=...=t„=l. 

1 m 

Before  we  proceed  with  our  discussion  of  R(0)  we  list 
the  following  well-known  results  governing  a nonnegative  mxm 
matrix  A^O.  We  refer  to  Gantmacher  [6]  for  the  proofs  of 
these  results. 

(Rl):  |6.|  < E a.,  for  every  eigenvalue  6.  of  A. 

I - j ij 

(R2):  There  exists  a nonnegative  eigenvalue  6 of  A satisfying 

6>|6^.  I for  any  other  eigenvalue  6^-  of  A.  6 is  called 
the  Perron-Frobeni us  (PF)  eigenvalue  of  A. 

(R3):  Suppose  B is  irreducible  and  B>A.  If  the  PF-eigen- 
values  of  A and  B are  equal,  then  A=B. 

(R4):  If  A is  stochastic,  then  the  PF-eigenvalue  of  A is  1. 


Suppose  now  that  the  matrix  R(0)  is  not  stable.  Then  by 
Theorem  1.3.18,  R(o)  has  an  eigenvalue  which  is  zero  or 
purely  imaginary.  In  either  case  for  every  t>0,  exp[R(0)t] 
has  an  eigenvalue  which  has  absolute  value  1.  Now  note  that 
for  all  i , j , 


I 

i 


) 


{exp[R(0)t]}^  j = P^j.(0,t) 

= P[N(t)=0,J(t)=j|N(0)=0,J(0)=i] 

I P[J(t)=j|N(0)=0,J(0)=i] 

= P^jd  .t)  = [exp(Q*t)]^j. 

Since  1 is  the  absolute  value  of  an  eigenvalue  of  exp[R(0)t], 
by  (Rl)  and  (R2)  and  the  sub-stochasti ci ty  of  P(0,t),  we  now 
have  that  the  PF-ei genval ue  of  P(0,t)  is  1.  Our  assumption 
of  the  irreducibil ity  of  Q*  and  (R3)  now  imply  that 

exp[R(0)t]  = exp[Q*t]  for  all  t>0, 
or 

R(0)  = Q*. 

Thus  we  have  proven 

Theorem  1.3.19:  If  R(0)ii«Q*,  then  R(0)  is  stable. 

Remark : The  condition  R(0)^Q*  is  equivalent  to  asserting 
that  for  some  i,  l<i£m,  at  least  one  of  the  conditions 

a)  X^[l-<>^(0)]>0, 

b)  for  some  j,  T^Oj [1 ^ (0 ) ]>0 , 
or 

c)  for  some  jj'i,  T^  (0)]>0, 

is  true.  From  the  definition  of  these  quantities  above,  it 
is  clear  that  if  the  above  condition  is  not  met  then  the  N- 
Process  cannot  develop  beyond  zero. 

We  shall  from  now  on  make  the  assumption  of  non- 
triviality of  the  N-Process,  viz.,  R(0)j*Q*,  so  that  the 


conclusion  of  Theorem  1.3.19  holds.  A useful  consequence  of 
this  assumption  we  now  record  as 


Corollary  1.3.20;  [sI-R(o)J"^  exists  for  all  s>0. 

Proof:  Since  R(0)  is  stable,  every  eigenvalue  of  sI-R(o), 
for  s>0,  has  positive  real  part  and  hence  the  result. 
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1.4  The  N/G/1  Queue  and  the  imbedded  semi-Markov  Sequence 

We  consider  a single  server  queue  in  which  arrivals 
occur  according  to  an  N-Process  defined  in  the  previous 
section,  and  the  service  times  of  successive  customers  are 
independent  identically  distributed  random  variables.  It  is 
assumed  that  the  input  and  the  service  processes  are  mutually 
independent.  Such  a model  will  be  denoted  by  N/G/1. 

For  the  purpose  of  discussing  queue  length,  busy  period 
etc.,  it  is  clear  that  the  order  of  service  is  immaterial; 
all  that  we  shall  assume  are  that  the  server  cannot  idle  as 
long  as  there  are  customers  in  the  system,  and  that  having 
started  a customer's  service,  the  server  must  proceed  to  its 
conclusion  without  interruption.  In  Chapter  V,  for  the 
purpose  of  discussing  the  virtual  waiting  time  alone,  we 
shall  make  the  additional  assumption  that  the  server  must 
serve  the  groups  in  the  order  of  their  arrival,  the  order  of 
service  within  each  group,  once  again,  being  arbitrary. 

For  describing  the  N-Process  characterizing  the  input  we 
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I 
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shall  use  the  same  notations  used  in  Section  1.2.  The 
service  time  c.d.f.  assumed  to  be  non-degenerate  will  be 


denoted  by  H(*).  its  Lapl ace-Sti el t jes  transform  (LSI)  by 
H(‘)  and  its  moments  (about  the  origin),  whenever  they  exist, 
by  ^ , i = l ,2 


We  now  define  the  r.v.s.  {t^:  n>o}  as  the  successive 


epochs  of  departure  and  assume  Tq=0.  Defining  and  to 
be  respectively  the  queue  length  (i.e.,  the  number  of  cust- 
omers in  the  system)  and  the  phase  of  the  N-Process  at  Tj^+, 
it  is  easily  seen  that  ( »Tn+l "'^n^  ’ form  a semi- 

Markov  sequence  with  state-space  {0,l,...}x{l m}  and 

transition  probability  matrix  0(‘)  given  by 


Q(x) 


Bq(x)  B^(x)  BgCx) 
Aq(x)  A^(x)  A2(x) 

0 Aq(x)  A^(x) 

0 0 Ao(x) 


• • • 


, x>0,  (1.4.1) 


where  the  mxm  matrices  of  mass  functions 

X 

A„(x)  = / P(n,u)dH(u),  n>0,  x>0, 

n 0-  " " 

n+1 

B^(x)  = (U|^*An_j^+l  )(x) , n>0,  x>0. 


(1.4.2) 

(1.4.3) 


and 


U.(x)={/  P(0,y)dy}{T»A“or(k)+Toq(k)+A(x)A(£(k))}, 

0- 

k>l,  x>0  (1.4.4) 


where  r(k)  and  q(k)  are  mxm  matrices  with  respective  entries 
r^j(k)  and  q^j(k),  £(k)  is  an  m-vector  with  entries  p^(k) 


and  A(£(k))  is  an  mxm  diagonal  matrix  with  £(k)  along  the 
diagonal.  Also  * in  the  definition  of  B^(’)  in  (1.4.3) 
denotes  matrix  convolution.  We  note  that  the  (i,j)-th  entry 
of  U|^(x)  is  the  conditional  probability,  given  J(o)  = i,  that 
the  first  arrival  occurs  at  or  before  x and  is  of  group  size 
k,  and  that  the  phase  of  the  N-Process  at  the  epoch  of  the 
f i rst  arrival  is  j . 

We  now  introduce  the  following  notations  for  use  in  the 
sequel,  will  denote  the  renewal  function  giving  the 

expected  number  of  visits  in  [o,x]  to  (k,*,)  by  the  Markov 
Renewal  Process  defined  by  Q(*)  given  that  the  initial  state 
is  (i,j).  Also  m(i,j)  will  denote  the  mean  recurrence  time 
of  the  state  (i,j)  in  the  Markov  Renewal  Process  Q(*).  For 
the  results  governing  these  quantities  we  refer  the  reader  to 
^inlar  [2]  and  Hunter  [8]. 

Before  concluding  this  section  we  point  out  that  most  of 
the  results  in  the  sequel  are  obtained  by  studying  the 
imbedded  semi-Markov  sequence  described  above,  and  we  shall 
invoke  many  a result  from  the  literature  governing  semi- 
Markov  and  Markov  Renewal  processes.  The  basic  definitions 
and  results  on  these  processes  are  by  now  quite  well-known, 
and  an  excellent  account  of  these  may  be  found  in  the  work  of 
^inlar  [2].  Among  the  basic  references  in  this  connection 
[2,8,18,24,25],  we  draw  particular  attention  to  those  of 
^inlar  [2],  Hunter  [8]  and  Neuts  [18]. 


1.5  Some  Special  Cases  of  the  N/G/1  model 


Below  we  present  a few  interesting  special  cases  of  the 
N/G/1  model.  Most  of  the  material  below  is  based  on  Neuts 
[22]  and  presented  here  for  completeness. 

(a)  PH/G/1  Queues:  In  the  definition  of  the  N-Process  if  we 
set  X^  = . . .=Xjjj=0,  i|»(z)hE,  $(2)=p(z)E,  where  E is  an  mxm  matrix 
each  of  whose  entries  is  1,  and  where  p(z)  is  the  p.g.f.  of 
the  group  size,  then  we  get  the  PH/G/1  queue  (with  group 
arrivals)  wherein  the  inter-arrival  times  are  i.i.d.  phase 
type  with  c.d.f.  F(*)  given  by  (1.2.2).  As  pointed  out 
earlier,  queues  with  exponential,  generalized  Erlang  and 
hyper-exponential  inter-arrival  times  are  but  few  of  the 
special  cases  of  this  large  class  whose  versatality  stems 
from  the  closure  properties  of  Phase  Type  distributions 
proven  in  [14]. 

While  some  of  the  very  special  cases  in  this  class  such 
as  the  M/G/1  and  E|^/G/l  models  have  been  discussed  earlier  in 
the  literature,  there  is  no  systematic  discussion  of  PH/G/1 
queues  in  their  generality.  The  nearest  attempts  at  this  are 
the  work  of  Carson  [1]  who  discussed  computational  methods 
for  PH/PH/1  queues,  i.e.,  queues  where  both  inter-arrival  and 
service  times  are  of  Phase  Type  and  that  of  Cox  [3]  who 
discussed  queues  with  "rational  arrival  processes",  a class 
of  processes  which  is  only  slightly  more  general  than  PH- 
Renewal  Processes.  In  this  connection  we  point  out  that 
the  present  theory  on  rational  arrival  processes,  due  to 


its  heavy  reliance  on  complex  arithmetic,  is  not  computa- 


tionally very  attractive.  As  will  be  seen  in  the  sequel. 


the  formulas  in  this  paper  are  presented  in  a form  computable 


in  real  arithmetic, 


Superposition  of  a Poisson  Process  and  a PH-Renewal 


Process:  Kuczura  [10]  considers  a queue  whose  input  process 


is  the  superposition  of  a Poisson  and  a renewal  process  where 


the  inter-arrival  times  of  the  latter  have  a rational  Laplace- 


Stieltjes  transform.  This  is  only  slightly  more  general 


than  considering  the  superposition  of  a Poisson  Process  and  a 


PH-Renewal  Process.  In  [22]  Neuts  has  pointed  out  the 


practical  merit  of  considering  queues  of  this  type  where  the 


Poisson  Process  describes  a "background  input"  and  the  PH- 


Renewal  Process  (with  group  arrivals)  describes  "burst 


inputs".  Such  a process  corresponds  to  a given  matrix  T and 


a vector  o and  the  parameter  choices  x^.=x,  it>^(z)  = z, 

<i'(z)  = p(z)E,  ij;(z)  = E,  where  p(z)  is  the  p.g.f.  of  the  group 


size  in  the  renewal  arrival  process  and  E is  an  mxm  matrix 


with  each  entry  equal  to  1. 


Stochastic  models  which  involve  superposition  of  (even 


as  few  as  two)  general  renewal  processes  are,  in  most  cases. 


intractable.  The  results  in  the  sequel  become  important  when 


one  notes  that  the  N-Process  contains  as  special  cases  a 


large  number  of  such  complex  models  as  the  one  described 


above. 


lueues  with  Markov-Modulated  Poisson  Arrivals:  If  in 


the  definition  of  the  N-Process  we  set  +(z)=*(z)=E  where  E 
is  an  mxm  matrix  of  I's,  and  (|)^(z)*z  for  l<i<m,  then  we 
obtain  the  Markov-Modulated  Poisson  arrival  process  which 
has  been  used  by  several  authors  [13,21,23,28]  to  describe 
the  input  to  queues.  Such  a process  can  be  used  to  model  a 
large  variety  of  queueing  phenomena  such  as  rush-hour 
behavior  and  others.  The  work  of  Heffes  [7],  which,  in  a 
telephone  engineering  context,  deals  with  the  interrupted 
Poisson  Process  in  which  arrivals  occur  on  alternating 
exponentially  distributed  intervals,  is  of  this  type  and 
corresponds  to  the  choice 


, ’-‘’1  “ll  T"  .P' 

0 -02  ^2 


, a = (1 ,0) 


<>^(z)ez,  X2=0,  <|>2(z)  arbitrary,  *(z)=i|»(z)  = 


G 0 


The  model  of  Heffes  can  be  easily  generalized  by  defining  an 
interrupted  Poisson  Process  on  an  alternating  renewal  process 
of  phase  type.  For  further  discussion  on  this  we  refer  the 
reader  to  Neuts  [22]. 


ueues  with  arrivals  inhibited  or  stimulated  by  renewals: 


In  his  paper  [22]  Neuts  discusses  how  tractable  qualitative 
models  for  arrival  streams  which  exhibit  an  inhibition  or 
stimulation  of  arrivals  for  a certain  length  of  time  by 
certain  renewal  epochs  can  be  modeled  as  an  N-Process.  Such 
models  are  of  considerable  practical  interest. 


A PH-Distribution  is  called  progressive  if  it  has  a 
representation  (a,T)  in  which  T is  upper- triangul ar.  It  is 
easy  to  see  that  a PH-Distribution  is  progressive  iff  it  is 
a finite  mixture  of  generalized  Erlang  distributions.  Since 
every  path  function  of  the  Markov  Process  Q is  then  non- 
decreasing, we  can,  by  suitable  choices  of  the  -parameters 
of  states  close  to  renewals,  model  any  inhibitory  or 
stimulatory  effect  of  the  renewal. 

The  examples  presented  above  should  indicate  to  the 
reader  the  wide  gamut  of  queues  that  are  special  cases  of  the 
N/G/1  model.  The  ensuing  discussion  which  presents  a unified 
treatment  of  these  special  cases  in  a computationally 
tractable  form,  we  hope,  enhances  the  merit  of  the  N-Process 
as  a versatile  model  for  describing  input  to  queues. 


CHAPTER  II 


i 

i 


THE  BUSY  PERIOD  AND  THE  BUSY  CYCLE 


2.1  Introduction 

In  this  Chapter  we  show  that  the  Semi-Markov  Process 
Q(*)  defined  in  Section  1.4  is  a special  case  of  a general 
class  of  such  processes  studied  by  Neuts  [18].  Appealing  to 
the  results  proven  in  [18]  we  obtain,  in  terms  of  an  appro- 
priately defined  traffic  intensity  p,  a necessary  and 
sufficient  condition  for  the  stability  of  the  N/G/1  queue  and 
derive  the  busy  period  characteristics  in  terms  of  the 
minimal  solution  in  the  class  of  sub-stochastic  matrices  of  a 
certain  non-linear  matrix  functional  equation.  The  necessary 
notations  and  preliminaries  to  this  end  are  set  forth  in 
Section  2.2.  In  Section  2.3  we  discuss  the  busy  period  of 
the  N/G/1  queue  obtaining  the  joint  transform  of  the  number 
of  services  during  a busy  period  and  the  duration  of  the  busy 
period.  We  also  obtain  the  expected  number  served  during  a 
busy  period  in  an  easily  computable  form.  The  last  section 
provides  a similar  discussion  of  the  busy  cycle . 

2.2  Notations  and  Preliminaries 

Throughout  this  paper  we  shall  adopt  the  convention  to 
denote  probability  mass  functions  by  upper-case  Roman  letters 


f 


superscripted  by  a tilde  and  their  Laplace-Stieitjes  trans- 
forms (LST's)  by  the  same  letters  without  the  tilde.  Thus 
Uk(’)»  ^respectively  denote  the  LST's  of 

0k(*).  values  of  these  LST's  at  0+  are 

respectively  denoted  by  U^.  and  B^.  We  let 

00 

A(x)  = E A„(x)  (2.2.1) 

n=0  " 

and  denote  the  LST  of  A(*)  by  A(*).  Also  A=A(0+).  We  now 

define  the  generating  functions 

00 

A(z,s)=  Z A„(s)z",  |zl<l.  Re  s>0.  (2.2.2) 

n=0  " 

and 

U(z,s)=  Z U.(s)z'^.  |z|<l.  Re  s>0,  (2.2.3) 

k=l 

and  note  that  A=A(1,0),  U=U(1,0). 

Lemma  2.2.4 

For  I z I <1 , Re  s>0 , 

U(z,s)=[sI-R(0)]'^[R(z)-R(0)]  (2.2.5) 


Proof 


00  .00 

U(z,s)=  z dU.  (x) 

k = l 0- 


Q e-'‘*P(0.x)d^[j^ 


z'^{T°A°or(k)+Toq(k)+A(A)A(2.(k))} 
by  (1.4.4) 


3 


■1 


=[sI-R(0)]-'[R(z)-R(0)] 


by  Corollary  1.3.20,  and  the  fact  that 


I z^{T°A°or(k)+Toq(k)+A{x)A(£(k) ) }=R(z)-R{0) 
k=l 

which  is  an  easy  consequence  of  (1.3.4). 

Basic  to  our  discussion  of  the  busy  period  and  the  busy 
cycle  are  the  first  passage  times  of  the  semi-Markov  process 
Q(*)  from  the  set  of  states  i_+l_={  (i  + 1 ,j ) : l<j<m}  to  the  set 
of  states  i={(i,j):  l<j<m}.  We  now  set  up  a number  of 
notations  to  describe  these  first  passages. 

Let  G^j^(k,x)  be  the  probability  that,  given  that  the 
semi-Markov  process  Q(*)  starts  in  the  state  (i,j),  it  reaches 
the  set  0 for  the  first  time  after  k transitions  by  visiting 
the  state  (0,j')  and  the  time  of  such  a first  passage  is 
atmost  X.  The  matrix  G^’^(k,x)  will  have  the  entries 
Gn?(k,x),  l<j,j'<m. 

In  particular,  the  matrix  G^^^(k,x)  will  be  denoted  by 
G(k,x).  The  sequence  of  matrices  {G(k,x):  k>0},  x>0,  defines 
completely  the  first  passage  time  distributions  from  1 to  0, 
and,  as  noted  by  Neuts  [18],  in  view  of  the  structure  of  Q(*) 
also  from  i + 1 to  i^,  for  i>0.  We  define  the  transform 

00  00  . 

G(z,s)=  E / e"^^dG(k,x)z'^,  (2.2.6) 

k = l 0- 

for  |z|<l  and  Re  s>0.  For  notational  convenience  we  shall 
write  G(l-,0+)  as  G. 

Noting  that  Q(*)  has  a structure  same  as  the  general 
class  of  such  matrices  discussed  by  Neuts  [18],  we  can 
specialize  the  general  results  to  the  case  at  hand.  Before 


we  state  the  relevant  results,  following  Neuts  [18],  let  us 
give  the 


Definition  2.2.7:  The  semi-Markov  process  Q(*)  is  boundary 
leading  iff  G>>0. 

The  following  theorem  establishes  the  boundary  leading 
property  of  the  semi-Markov  process  Q(*)- 

Theorem  2.2.8: 

(i)  A is  irreducible  and  stochastic. 

(ii)  The  diagonal  entries  of  Aq  are  all  positive. 

Proof : 

(i)  follows  from  the  i rreducibi 1 i ty  of  Q*  and  the  non- 
degeneracy of  H(*).  in  view  of  the  relation 

00 

A = / exp(Q*t)dH(t).  (2.2.9) 

0- 

(ii)  is  obvious  by  noting  that  for  every  l<i<m, 

00 

An(i.i)  = / P,.,.(0,x)dH(x) 

^ 0- 

and  that  P^^(0,x)>0  for  every  x>0. 

Corollary  2.2.10:  The  semi-Markov  process  Q(*)  is  boundary 
leading. 

Proof;  By  Theorem  2.2.8  and  the  structure  of  Q(*).  it  is 
seen  that  QC*)  is  irreducible.  It  is  obvious  that  this 
implies  the  boundary  leading  property. 


t 


We  now  state  the  basic  results  obtained  by  Neuts  [18]  as 
Theorem  2.2.11: 

(i)  If  we  define  6^^^(z,s)  as  the  analogous  transform 
of  : k>0,  x>0},  then  G^’^(z,s)  is  the  i-th  power  of 

the  matrix  G(z,s) . 

(ii)  G(z,s)  satisfies  the  non-linear  matrix  functional 
equati on 

00 

G(z,s)=z  Z A (s)g"(z,s)=zA(G(z,s),s)  (2.2.12) 

n = 0 

where  A(z,s)  is  as  in  (2.2.2). 

(iii)  For  0<z<l  , s>0,  there  exists  a unique  nonnegative 
matrix  G(z,s)  which  satisfies  Equation  (2.2.12).  The  entries 
of  G(z,s)  are  analytic  functions  of  z and  s,  and  the  matrix 
G(z,s)  may  be  written  in  the  form  (2.2.6),  and  the  entries  of 
all  matrices  G(k,*)»  k>0  are  probability  mass  functions.  The 
matrices  G(k,<»),  k>0  are  all  nonnegative,  and  the  matrix 

00 

G = G(l-,0+)  = Z G(k,»),  (2.2.13) 

k=l 

defined  by  continuity,  is  sub-stochastic. 

(iv)  Let  p=i6,  where  ^ is  the  invariant  probability 
vector  of  A and 

00 

i = Z nA^e.  (2.2.14) 

If  p<l,  the  matrix  G is  stochastic.  If  p>1  , at  least  one 
component  of  G^  is  less  than  one. 


(v)  The  matrix  6 is  the  minimal  solution,  in  the  class 


of  sub-stochastic  matrices,  of  (2,2.12)  with  z=l , s=0,  and  i 

can  be  computed  by  the  recurrence  relations  i 

(2.2.15)  I 

j 

i 

The  matrices  {G^:  n>0}  defined  above  are  non-decreasing.  j 

(vi)  The  Markov  Renewal  Process  defined  by  Q(*)  is 
positive  recurrent,  null  recurrent  or  transient  according  as 
p is  less  than,  equal  to  or  greater  than  1. 

Remarks ; j 

1 

(i)  The  equation  (2.2.12)  is  the  analogue  of  Takacs' 
equation  [26]  for  the  M/G/1  queue. 

(ii)  The  recurrence  relation  (2.2.15)  yields  rapid  con- 
vergence and  thus  facilitates  easy  computation  of  the  matrix 
G • 

Theorem  2.2.16; 

(i)  i.=l,  where  £ is  the  invariant  probability  vector 

of  Q*. 

(ii)  where  c*  is  the  "arrival  rate"  given  by 

(1.3.14)  and  is  the  mean  service  time. 

I 

(iii)  The  N/G/1  queue  is  stable  iff  p<l . 

Proof:  j 

(i)  follows  from  (2.2.9)  and  the  uniqueness  of  the  i 

i 

invariant  probability  vector.  i 


Go=0 


G .-i  = S A G , n>0 

n+1  _n  V n = 
v=0 


(i i ) Noting  that 

” 3 

p = E nA„e=^  A(z  ,s  )e 
- n-  3z 


z = l- 
s = 0+ 


= / M(t)e  dH{t) , 

0- 


we  have  by  (1.3.8) 


» r ® .n  n-1  „ , 'I 

6 = ; / 2 fr  ^ Q*''R'(1)  Q*""'"''  e > 

0-U=l  v=0  J 


dH(t). 


:*  ..(1) 


whence , 

P = ee  = c*  y 

in  view  of  (1.3.14)  and  the  fact  that  £Q*=0. 

(iii)  is  only  a re-statement  of  Theorem  2.2.11  (vi) 


Remark : In  view  of  the  remark  following  Theorem  1.3.15,  p 
may  be  called  the  traffic  intensity  of  the  N/G/1  queue.  The 
N/G/1  queue  is  stable  iff  the  traffic  intensity  is  less  than 
1.  In  the  sequel  we  shall  always  assume  that  p<l . 

2.3  The  Busy  Period 

Note  that  from  its  definition  it  is  clear  that  G^*^^(z,s) 
for  k>l  completely  specifies  the  busy  period  which  starts 
with  k customers  of  the  N/G/1  queue.  In  this  section  we  will 
be  concerned  with  the  first  busy  period  of  the  N/G/1  queue 
given  that  the  queue  starts  with  no  customers  at  time  0.  As 
will  be  evident  later,  this  discussion  will  be  found  useful 
in  determining  the  invariant  probability  vector  of  Q(»). 


Hl'f 


1 


In  the  last  section  we  noted  that  the  matrix  G Is 
strictly  positive  and  stochastic.  We  let  £ denote  the  Invar- 
iant probability  vector  of  G and  define  G“°  to  be  the  mxm 
matrix  each  of  whose  rows  Is  £.  Defining  Uj  to  be  the 
expected  first  passage  time  from  (1+1  ,j)  to  1^,  1>0,  In  the 


semi-Markov  process  Q(*)  and  p.  to  be  the  expected  number  of 

J 


service  completions  during  such  a first  passage,  we  can 

easily  prove  the  following  result  which  yields  the  vectors 

and  ^ whose  j-th  components  are  respectively  p.  and  p,. 

J j 


Theorem  2.3.1 


P = (I-G+G°“)[I-A+G“‘’-A(s)6”°]’^e 


and 


li.=  (I-G+G°°)[I-A+G°“-A(i)G°°]"^p^^  ^e, 
where  A(£)=d1ag(e^ , . . . ,6^)  and  ^ Is  as  In  (2.2.14) 

Proof : It  Is  shown  In  [18]  that 

p=(I-G+G°“)[I-A+G®°-A(e)G°°]'^e 


(2.3.2) 

(2.3.3) 


and 


£=(I-G+G®°)[I-A+G°‘’-A(i)G“°]‘^  l Ap^e, 

n = 0 " “ 


where 


(1). 


I 

J 


r 

L 


i 

Remarks : Higher  moments  of  the  duration  of  the  first  passage  ! 

times  and  the  number  served  during  such  first  passages  can  be  i 

found  by  differentiation  of  equation  (2.2.12).  We  refer  the 
reader  to  Neuts  [18]  for  the  formulas  and  computational 
methods  governing  these  quantities. 

Corollary  2.3.4: 


Remark : Equation  (2.3.5)  simply  states  that  the  expected 
first  passage  time  is  the  product  of  the  expected  number 
served  during  such  first  passage  and  the  expected  duration  of 
each  service,  a result  which  is  intuitively  quite  obvious. 

Corollary  2.3.6: 

a.  i = (1-p)'^  (2.3.7) 

a.  u = ^ (l-p)"^  (2.3.8) 

Proof : These  follow  easily  from  (2.3.2)  and  (2.3.3). 

Remark : The  formulas  (2.3.5),  (2.3.7)  and  (2.3.8)  provide 
powerful  computational  checks  on  the  accuracy  of  numerical 
computations  of  ^ and  using  Theorem  2.3.1.  Having  computed 
6 using  (2.2.15),  with  a little  additional  effort  one  can 
easily  compute  £ using  an  algorithm  such  as  Wachter's  method 
[27]. 


We  now  define  L(z,s)  to  be  the  joint  transform  of  the 
number  served  and  the  duration  of  the  first  busy  period  of  the 


N/G/1  queue,  given  that  at  time  0 there  are  no  customers  in 
the  system.  The  matrix  of  mass  functions  L(k,x)  associated 
with  L(z,s)  is  such  that  its  (j,j')-th  entry  is  the  con- 
ditional probability,  given  X(0)=0  and  J(0)=j,  that  the  first 
busy  period  of  the  N/G/1  queue  is  of  duration  less  than  or 
equal  to  x and  consists  of  k services  and  that  at  the  epoch 
where  the  busy  period  ends  the  phase  of  the  N-Process  is  j'. 

A direct  probabilistic  argument  yields 

Theorem  2.3.9: 

L(z,s)=  E U.(0)  g'^(z,s)  = U(G(z,s),0)  (2.3.10) 

k = l 

where  U(z,s)  is  given  by  (2.2.3). 

Defining  and  y’t  to  be  respectively  the  mean  number 
J J 

served  during  and  the  mean  duration  of  the  first  busy  period 
given  X(0)  = 0,  J(0)=j,  and  and  £*  to  be  the  vectors  with  iit 

J 

and  as  their  respective  j-th  entries,  l<j<m,  we  can  now 
prove 


Theorem  2.3.11  : 

P*=[U(1  ,0)-U(G,0)-R'^  (O)R'  (1  )G°°](I-G+G‘“’)"^i  (2.3.12) 

li.*=[U(l  .0)-U(G,0)-R‘^(0)R'  (1  )G““](I-G+G°°)‘V  (2.3.13) 


Proof: 


i*  = L(z,s)e 


z=l- 
s = 0+ 


» k-1 

= E U.  (0)  E G\ 
k = l v=0 


by  (2.3.10) 


t 

= 1^  U^(0)(I-G'^+kG*’'’)J  (I-G+G°°)'^H. 

= [U(1  .0)-U(G,0)-R"^  (O)R'  (1  )G“‘’](I-G+G'’‘’)'^w. 

The  third  equality  above  is  obtained  by  rewriting 

k-1  . fk-1  „ ^ n 

i g'^=(  i:  G'^(I-G+G“°)  > d-G+G"®)" ' 
v=0  Lv=0  J 

I and  using  the  fact  that  GG®°  = G®®G=G“® . The  last  equality 

follows  from 

00 

£ k UdO)  = -R’^(0)R'(1). 
k=l 

a formula  provable  by  differentiating  (2.2.5)  with  respect  to 
z and  setting  z=1-,  s=0+. 

The  proof  of  (2.3.13)  is  analogous  and  hence  omitted. 

Corollary  2.3.14: 

p*  = yO)  (2.3.15) 

Remarks : Although  the  formulas  (2.3.12)  and  (2.3.13)  above 
appear  to  be  rather  complicated,  in  actual  practice  they  are 
well-suited  to  numerical  computations.  Note  that 
U( 1 ,0)=I-R"^ (0) (T+T®A° ) while  implementing  these  formulas. 

The  formula  (2.3.15)  is,  once  again,  quite  intuitive.  ; 

2.4  The  Busy  Cycle 

The  subject  matter  of  this  section  are  the  successive  1 

returns  of  the  semi-Markov  process  Q(*)  to  the  level  0.  Let 
Kq(z,s)  be  the  joint  transform  of  the  number  served  during 
and  the  duration  of  the  busy  cycle.  KQ(n,x),  the  matrix  of 


mass  functions,  of  which  K(z,s)  is  the  transform  is  such 
that  its  (j,j')-th  entry  yields  the  conditional  probability, 
given  that  the  busy  cycle  starts  in  phase  j,  that  the  busy 
cycle  consists  of  n services,  is  of  duration  atmost  x and 
ends  in  phase  j'.  By  a direct  probabilistic  argument  we 
obtain 

Theorem  2.4.1 ; 

Kq(z,s)  = [sI-R(0)J’''[-R(0)]L(z.s)  (2.4.2) 

where  L(z,s)  is  given  by  (2.3.10). 

Proof: 

00 

Kq(z,s)=  i zB  (s)G'’(z,s) 

v=0 

” r v+1 
= r z^  E 
v=0  Lk=l 
00 

= z u.  (s)g'^(z,s),  using  (2.2.12) 
k=l 

=U(G(z,s) ,s) 

= [sI-R(0)]’^^Z^{T‘*A»or(k)+Toq(k)+A(x)A(B.(k))}G''(z,s) 

= [sI-R(0)]'^[-R(0)]  Z U.  (0)g''(z,s) 

k=l 

=[sI-R(0)]-’[-R(0)]L(z,s). 


(s)A^.k+i(s) 


G''(z,s) 


^ I 

By  evaluating  » we  can  easily  prove 

^ ls=0+ 

Theorem  2.4.2:  Let  Pj  be  the  mean  duration  of  a busy  cycle 
starting  in  phase  j,  l<j<m.  The  vector  p whose  J-th  entry  is 
Pj  is  given  by 

I = i^*-R"^(0)e  (2.4.3) 

-1 

Remark:  Note  that  the  j-th  entry  of  -R  (0)e=/  P(0,y)e  dy 

0- 

is  the  expected  duration  of  an  idle  period  starting  in  phase 
j.  In  view  of  this,  (2.4.3)  is  simply  the  statement  that  the 
expected  duration  of  the  busy  cycle  is  the  expected  duration 
of  the  idle  period  plus  the  expected  duration  of  the  busy 
period  following  the  idle  period,  a result  which  again  is 
intuitively  obvious! 

We  conclude  this  Chapter  by  pointing  out  that  it  appears 
possible  to  simplify  many  of  the  formulas  above  in  certain 
special  cases.  While  we  shall  not  pursue  this  line  in  detail 
we  present  below  a few  results  for  the  PH/G/1  queue  to 
illustrate  our  point. 

Special  Case:  PH/G/1  queue  (with  single  arrivals) 

In  this  case  since  R(0)=T,  D=E,  C = 0,  ^nd  U(z,0)=A°'’z 
many  simplifications  occur.  For  example,  we  have 

= (ay)£  (2.4.4) 

as  is  seen  by  specializing  in  (2.3.11). 


Further,  In  this  case  it  may  be  verified  that 


KQ{z,s)  = (sI-T)'h*A‘’G{z.s) 

= {{sI-T)"^r}{aG(z,s)} 

showing  that  the  idle  period  and  the  busy  period  are 
independent. 


t 


CHAPTER  III 


THE  STATIONARY  QUEUE  LENGTH  DISTRIBUTIONS 

3.1  Introduction 

In  this  Chapter  we  discuss  the  stationary  distributions 
of  the  queue  length  (i.e.,  the  number  of  customers  in  the 
system)  at  a point  of  departure  and  at  an  arbitrary  epoch  t. 

In  general,  these  two  are  shown  to  be  different.  Section  3.2 
discusses  the  stationary  distribution  of  the  queue  length  at 
a point  of  departure.  This  is  followed  by  a discussion  of  the 
stationary  queue  length  distribution  at  an  arbitrary  epoch  t 
in  Section  3.3.  We  show  that  the  stationary  probability  that 
the  server  is  idle  at  an  arbitrary  epoch  t is  (1-p)  where  p 
is  the  traffic  intensity  defined  earlier  - a result  which  is 
pleasantly  surprising  and  not  too  obvious  in  view  of  the  non- 
recurrent nature  of  the  input. 

3.2  Queue  length  at  epochs  of  departure 

The  stationary  queue  length  density  at  the  point  of 
departure  is  denoted  by  x and  is  obtained  by  computing  the 
invariant  probability  vector  of  the  irreducible  stochastic 
matrix  Q(“>)  which  under  the  assumption  p<1  is  ergodic.  The 
defining  system  of  equations 

xQ(«)  = x»  x§.=  l (3.2.1) 


A 


can,  after  partitioning  the  vector  x as 


2L  = (xo’^-i 


(3.2.2) 


be  written  as 


i + 1 

Xi  = x^Bi+  -Xk^i-k+l’  ^ = (3.2.3) 

Multiplying  in  (3.2.3)  by  and  summing  over  i>0,  we  can 
easily  obtain 


Theorem  3.2.4:  The  generating  function 

^ • 

X(z)=  z x,-z\  |z|<l  , (3.2.5) 

i = 0 ^ 

satisfies  the  equation 

X(z)[2I-A(z,0)]=Xq[U(z,0)-I]A(z,0)  (3.2.6) 

where  U(z,s)  and  A(z,s)  are  given  by  (2.2.3)  and  (2.2.2) 
respectively. 

Corollary  3.2.7: 

00 

X(l-)=  z x.  = -XnR"^  (O)(T+T“A“)A(I-A+0)'U0  (3.2.8) 

i = 0 ^ ^ 

Proof : Let  z-»-l-  in  (3.2.6).  We  get 
X(1-)[I-A]  = Xq[U(1  ,0)-I]A. 

Adding  ^(l-)0  to  both  sides  and  noting  that  ^(  1 - )0=  (^(  1 - )e^)^= 
0 and  U(1,0)-I  = -R'^(0)(T+T‘>A“),  we  get 

X(l-)(I-A+0)=-2^R"^(O)(T+T"A“)A+i. 

(3.2.8)  follows  from  the  non-singularity  of  (I-A+0)  and  the 
fact  that  £(I-A+0)=£. 


F -- 

Corollary  3.2.9:  X(l-)e=l 

, Remarks : In  practice,  the  system  of  equations  (3.2.3)  is 

solved  by  truncating  the  number  of  equations  at  a sufficiently 
large  value  of  the  index  i and  then  applying  an  algorithm 
such  as  Gauss-Sei del . In  the  next  chapter  we  shall  derive 
the  first  two  moments  of  the  queue  length  with  which  one  may 
truncate  the  system  (3.2.3)  using  a "y+3a  limit".  Below  we 
will  provide  a method  of  computing  directly  using  which 
^(1-)  may  be  computed  through  (3.2.8).  Equation  (3.2.8) 
provides  an  excellent  computational  check  on  the  numerical 
computation  of  x* 

Below  we  give  an  alternate  method  for  determining  the 
vectors  Xq  and  x^  which  can  be  effectively  used  in  the 
numerical  computation  of  x for  initialization  purposes  in  an 
algorithm  such  as  Gauss-Sei del  . 

Lemma  3.2.10:  The  matrix  L(1,0)  defined  by  continuity  in 
(2.3.10)  is  irreducible  and  stochastic. 

’ Proof : We  have 

00 

L(1  ,0)  = U(G,0)  = -R‘^  (0)  E {T°A°or(k)+Toq(k)+A(x)A(p(k))}G'^ 

k = l 

from  which  the  stochasti ci ty  of  L(1,0)  is  easily  verified. 

1/ 

Now,  since  the  strictly  positive  stochastic  matrices  G -»-G°° 
as  k->“,  there  exists  an  e>o  such  that 

G^^ieE  for  al  1 k>l  , 

t 

f 

I 

L 


" -- 
i 

I where  E is  the  mxm  matrix  with  each  entry  equal  to  one. 

(Then 

» L(1 .0)>-R"^ (0)[R(1 )-R(0)]eE=£E>>0,  j 

t I 

f “ 1 

I E {T°A°or(k)+Toq(k)+A(x)A(p{k))}  = R(l  )-R(0)  I 

! . k=l  ~ j 

, and  j 

R(1  )e  = (T+T“A°)e  = 0.  j 

I J 

I 

I In  the  sequel  we  let  denote  the  invariant  probability 

vector  of  L(1,0).  The  computation  of  Kq,  can,  once  again,  ; 

be  easily  done  by  Wachter's  method  [27].  We  now  prove 

Theorem  3.2.11 : 

^0  = (3.2.12) 

where  Kq  is  the  invariant  probability  vector  of  L(1,0)  and 
p*  is  given  by  (2.3.12). 

Proof:  The  probability  x(0,j)  is  the  inverse  of  the  mean 
recurrence  time  of  the  state  (0,j)  in  the  Markov  chain  Q(“). 

That  mean  recurrence  time  is  clearly  the  same  as  the  mean 
recurrence  time  of  (0,j)  in  the  Markov  Renewal  Process  of 
lattice  type  Kq(z  ,0)  = L(2 ,0) . By  applying  Theorem  2.11, 

I p.  196,  Hunter  [8],  the  mean  recurrence  time  of  (0,j)  is 

» 

j given  by  (iCQ^*)/(icQ) ^ where  (KQ)j  is  the  j-th  component  of 

Kq  whence  the  result. 


We  now  discuss  some  special  cases  and  show  that  the 


above  formula  for  Xq  particularizes  correctly  in  those 


si tuati ons 


’a)  M/G/1  queue:  It  is  trivial  here  to  verify  that 


Xq=(1-p),  for,  <Q=1  and  XQ=(vi*)"  =(l-p)  in  this  case, 


M/G/1  queue  with  group  arrivals:  In  this  case  the 


above  formula  for  Xq  simplifies  to 


Xg  ~ (l”p)/n» 


where  n is  the  mean  group  size,  and  p=Xnu 


(c)  PH/G/1  queue  (with  single  arrivals);  We  have  already 


shown  that  in  this  case  L(1,0)=A°°G.  Now, 


(oG)A°°G=(aGe)(aG)=aG 


whence 


£g=aG . 


We  noted  earlier  at  the  end  of  Chapter  II  that  ^*=(a^)e. 
Putting  all  this  in  (3.2.11)  we  get 


^0  = h 


(3.2.13) 


Note  the  highly  intuitive  formula 


XQe= 1 / ( op )=1 / (mean  number  served  in  a busy  period) 


which  holds  in  this  case! 


To  obtain  the  vector  X]  we  consider  the  first  passage 
times  from  the  set  l={(l,j):  l<j<m}  to  itself.  Let  K,|(n,x) 
be  an  mxm  matrix  such  that  its  (i,j)-th  entry  is  the  prob- 


ability that  starting  in  (l,i)  the  Markov  Renewal  Process 
Q(*)  returns  for  the  first  time  to  the  set  1 in  exactly  n 


steps  at  or  before  time  x and  that  the  phase  at  the  epoch 


of  such  a first  return  is  j.  Let 


OD  00 


K,(z,s)=  E z"  / (n,x) , |z|<l.  Re  s>0, 

' n=0  0-  ' 


Theorem  3.2.14 


CD 

(z,s)  = z2AQ(s)[I-zBg(s)]"^  Z B^(s)G''’^  (z,s) 

v=l 


+z  Z A (s)G'"^z,s). 
v=l  '' 


(3.2.15) 


Proof:  By  a simple  probabilistic  argument  considering  the 

paths  which  pass  through  0 and  those  that  do  not,  we  have 

00  00 

K,  (z  ,s)  = zA-(s)  Z z’"bJJ(s)  z zB  (s)G'’'^  (z,s) 

' r=0  v=l 

+ z zA  (s)G''"^  (z,s) , 
v=l 

and  simplifying  we  get  (3.2.15). 

Corollary  3.2.16:  K^(1,0)  is  irreducible  and  stochastic. 

Theorem  3.2.17:  Let  denote  the  invariant  probability 
vector  of  ( 1 ,0) . Then 

2Ll  ~ ^ £-1 11* ) ^ £l  » (3.2.18) 

where  Jl*=j£  K^(z,0)j  is  the  vector  of  the  mean  number 
of  steps  in  a first  passage  from  1_  to  itself  and  is  given  by 
£*=e+AQ( I-Bq)"^ e + 

r (v-l)B  G”)  t 

L.  v=l  v=l  v = 2 

(A-Aq)-  g a^g'-U  j 

v=l  v=2 


(v- 


1 )A  G°° 

V 


(I-G+G°“) 


1- 

V 


(3.2.19) 


Proof:  Note  that  k?  is  the  vector  of  mean  sojourn  times  in  ! 

I I 

the  Markov  Renewal  Process  K^(z,0)  which  is  of  lattice  type. 

The  formula  for  Xi  is  got  by  an  analogous  argument  as  in  | 

' i 

t 

Theorem  3.2.11  using  a theorem  in  Hunter  [8].  The  formula  ! 

i 

for  given  above  is  obtained  by  directly  computing  | 

|—  K,(z,0)  using  (3.2.15)  and  simplifying  the  resulting  I 

o Z I ' 

I 

expression.  ; 


Remarks : 

(i)  It  can  be  verified  that  the  expressions  given  for 
Xq  and  x^  in  (3.2.12)  and  (3.2.18)  respectively  do  indeed 
satisfy  the  steady  state  equation 


— 0 ~ — o^o'^~i^o 


(3.2.20) 


We  shall  omit  the  tedious  details  and  refer  the  reader  to  , 

Lucantoni  [11]  for  such  a verification  in  a more  general  set-  < 

I 

I 

up . j. 

j 

(ii)  Equations  (3.2.12)  and  (3.2.18)  are  easy  to  i 

i' 

implement  and  have  been  successfully  used  by  Lucantoni  [11] 
for  numerical  computation  of  Xq  and  X]  in  more  general 
models  than  the  one  discussed  here. 

(iii)  The  steady-state  equation  (3.2.20)  provides  a 
powerful  computational  check  for  the  numerical  computation 
of  and  2Li  using  (3.2.12)  and  (3.2.18)  respectively. 

3.3  Queue  Length  in  Continuous  Time 

In  this  section  we  discuss  the  stationary  distribution 


of  the  queue  length  at  an  arbitrary  epoch.  We  define 


y(i,j)=Lini  P[X(t)  = i .J  (t)=j  | X(0)  = r ,J  (0)=j  ' ] 

t-voo 

where  X(t)  and  J(t)  denote  respectively  the  queue  length  and 

the  phase  of  the  N-Process  at  t+.  Let  be  the  m-vector 

whose  components  are  y(i,j),  l<j<m  and  let  y.=  (y.o»y.-|  »••••)  • 

We  also  define  the  generating  function 

Y(z)  = E 

i = 0 ’ 


Lemma  3.3.1: 

(3.3.2) 

Proof : From  the  relation 

A(z,0)=/  exp{R(z)t}dH(t) 

0- 


we  have 


R(z)A(z,0)=A(z,0)R(z).  (3.3.3) 

Differentiating  this  with  respect  to  z,  letting  z-»-l-  and 
multiplying  the  resulting  equation  by  e,  we  get 


(T+T°A°)e=(A-I)R' (1 )e=(A-I-0)R' (1 )e+0R’ (1 )e  (3.3.4) 

Now,  differentiating  (3.2.6)  with  respect  to  z we  get  on 
letting  z->l-, 

X' (1-)[I-A]+X(1-)[I-A' (l-.O)]  = 

XQ^Ud  ,0)-I]A'(1-,0)+XqU'(1-.0)A 

Adding  )^'(l-)0  to  both  sides  and  multiplying  by  e we  get 

X'  (l-)e+l-X(l-)3=-XoR"^ (0)(T+T°A®)e-XoR'^ (O)R' (1 )e+X' (l-)e 


1 

I 

1 

I 
I 

I 

I 

In  the  above  if  we  substitute  the  value  of  X(l-)  using 
(3.2.8)  and  the  value  of  (T+T®A®)^  using  (3.3.4)  and 
simplify,  we  get 

-XqR"^ (O)0R' (1 )e=(l-p)  (3.3.5) 

or 

(-2LoR'^0)e)(iR'(l)e)=(l-p). 

That  is  -XqR'^ (0)e=(l-p)/C*.  The  Lemma  follows  by  noting 
that  e*=0R' (1 )e=p/p^^ ^ 

Theorem  3.3.6; 

Lq  = -C*XoR'^(0)  (3.3.7) 

Proof : Recalling  that  R^.j  (•)  are  the  renewal  functions  of 
the  Markov  Renewal  Process  Q(*).  we  can  write  by  a standard 
argument  considering  the  state  of  the  semi-Markov  process 
0(*)  at  the  epoch  of  the  last  transition  before  t, 

P{X(t)  = 0,J(t)  = j|X(0)  = i' .J(0)  = j'}=  E / dR^  J (u)P.  .(0,t-u). 

k=l  0- 

Letting  t-><»  in  the  above  equation  and  applying  the  Key 

Renewal  Theorem  (Theorem  6.3,  p.  153,  finlar  [2]),  we  get 

m 1 

y(0,j)=  E m"'(0,k);  P.  .(0,u)du  (3.3.8) 

k=l  0- 

where  m(0,k)  is  the  mean  recurrence  time  of  (0,k)  in  Q(*)* 

By  considering  the  Markov  Renewal  Process  Kq(1,s)  it  is 
easily  seen  that  m(0,k)  is  also  the  mean  recurrence  time  of 
(0,k)  in  this  Markov  Renewal  Process.  By  Theorem  2.11, 
p.  196,  Hunter  [8],  we  have 


J 


t 


(3.3.9) 


r 


ni(0,j  ) = (icQy)/(KQ)j , l<j<in 

where  kq  is  the  Invariant  probability  vector  of 
Kq( 1 ,0)  = L( 1 ,0)  and  p is  the  vector  of  mean  durations  of  the 
busy  cycle  given  by  (2.4.3).  Putting  (3.3.9)  in  (3.3.8)  and 
writing  (3.3.8)  in  vector  notations,  we  have 

= (2.4.3) 

= (2.3.15) 

= [p^^^-XoR‘^0)e]‘''[-XQR'^0)]  by  (3.2.12) 

= -C*2LqR'^0)  by  (3.3.2). 


Corollary  3.3.10:  The  stationary  probability  that  the 
queue  is  empty  at  an  arbitrary  epoch  t is  given  by 


(1-p) 


(3.3.11 ) 


Proof : This  follows  easily  from  (3.3.7)  and  (3.3.2). 


Special  Cases: 

1.  For  the  M/G/1  queue  (with  group  arrivals)  it  is  easily 
verified  that  (3.3.7)  reduces  to  yQ=(l-p). 

2.  For  the  PH/G/1  queue  (with  single  arrivals),  formula 
(3.3.7)  can  be  shown  to  reduce  to 


^0 

from  which  we  get 


(ct^GT  ^e^-p^^^ap)  ^o^GT  ^ 

( 

1 


ilQe=(-aGT'^e+p^^  (-“GT'^e) 


(3.3.12) 


These  are  obtained  by  using  (3.2.12)  and  the  fact  R(0)=T. 

In  (3.3.12)  it  may  be  noted  that  (-aGT"^^)  is  the  expected 

length  of  an  idle  period,  for,  a busy  period  starts  with  a 

phase  given  by  a whence  the  phase  at  the  end  of  the  busy 

period  is  given  by  aG,  and  further  -T  e=/  P(0,y)e  dy.  Thus 

0- 

in  (3.3.12)  which  is  the  stationary  probability  that  the 
queue  is  empty  at  an  arbitrary  epoch  t is  simply  the  ratio 
of  the  expected  duration  of  an  idle  period  to  the  expected 

duration  of  the  busy  cycle,  a result  which  is  quite 

i ntui ti ve ! 


Let  us  now  define 


and 


" “ - -1  ni 

6^=/  X E dB  (x)e=-R  (0)e+y'  ^e 

^ 0-  v=0 


00  00 

X E dA  (x)e=y 
0-  v=0 


k>l . 


Also  let  = »••••)  • Note  that  6(i,j)  is  the  mean 

sojourn  time  in  (i,j)  for  the  Markov  Renewal  Process  0(*)' 
From  this  we  have 


Theorem  3.3.13:  The  mean  recurrence  time  of  (i,j)  in  the 
Markov  Renewal  Process  Q(*)  is  given  by 


(i  .j )=(xi)'^x(i ,j ) = 5*x(i ,j ) 


(3.3.14) 


Proof : It  suffices  to  verify  that 


x6  = (0)e+M^^  ^e]+  E 

— -0  - - „=i-n 

= -2LqR~^  (0)e+vi ^ ^ ^ since  Z x^e=l 
= (C*)"^  by  (3.3.2) 

We  are  now  ready  to  compute  the  vectors  , i>l. 

Theorem  3.3.15:  For  i>l, 

^.=  Z C*[XoUy(0)+x^]/  {l-H(u)}P(i-v,u)du  (3.3.16) 
v=l  0- 

Proof : By  considering  the  epoch  of  the  last  departure 
before  t we  can  write 


P{X(t)=i,J(t)=j|X(0)=i'.J(0)=j'}  = 
t m t-u  i m 

/ z dRl^.J  (u)  / {l-H(t-u-x)}  z z [dU  (x)].  P .(i-v,t-u-x) 
0-  lc=l  0-  v=l  p=l 

i t m . , . , 

+ z / z dR\J  (u)P.  .(i-v,t-u){l-H(t-u)} 
v=l  0-  k=l 


Letting  t->-“  and  applying  the  Key  Renewal  Theorem  (Theorem 
6.3,  p.  153,  p'nlar  [2])  we  obtain 


y(i  .j)  = 


m , “ 

^ Z m"  (0,k)/ 
k=l  0- 


t _ 1 m 
/{l-H(t-x)}  Z Z 
0-  v=l  p=l 


[<)U^(x)]kpPpj(1 


dt 


i m , "o 

+ z z m‘'(v,k);  Pn(i-v,t){l-H(t)}dt 

v=l  k=l  0- 


Using  (3.3.14)  and  putting  the  above  in  matrix  notations 


“ ft  i 

f {l-H(t-x)}  Z dU„ 

' ^ O-io-  v=1 

i • 

+5*  E X / {l-H(t)}P(i-v,t)dt.  (3.3.17) 

v=l“''  0- 


(x)P(i 


-v,t-x) 


dt 


Now 


t _ i 

/ / {l-H(t-x)}  z dO  (x)P(i-v,t-x)dt 


0-  0- 


v=l 


00  *j  00 

/ z du  (x)/  {l-H(t-x)}P(i-v,t-x)dt 


0-  v=l 


X- 


Z U (0)/  {l-H(u)}P(i-v,u)du. 


v=l 


0- 


Putting  this  in  (3.3.17)  and  simplifying  we  get  (3.3.16) 


Theorem  3.3.18;  The  generating  function  X(z)=  z is 

i = 0 ^ 

given  by 


,-l 


5*(z-l )X(z)R" ' (z)  if  0<z<l 


Y(z)  = 


(3.3.19) 


if  z = l 


Proof:  We  have,  for  0<z<l , 
i 


I(2)-Xn=  ^ ^ 5*[XnU  (0)+x  1/  {l-H(u)}P(i-v.u)du  z^ 

^ i=l  v=l  ^ 0- 

00  00 

= E ?*[xoU^(0)+x  Iz'*  / {l-H(u)}P(z.u)du 

v=  1 0- 

00 

=5*[XotU(z,0)-I}+X(z)]/  {l-H(u)}P(z,u)du  (3.3.20) 


Under  our  assumption  R(0)?<Q*  it  is  easily  shown  that  R(z)  is 
stable  for  0<z<l  and  thus  R”^{z)  exists  for  0<z<l . (The 
proof  of  this  is  exactly  analogous  to  the  one  establishing 
the  non-singularity  of  R(0)  presented  in  Section  1.3  and 
hence  omitted.)  Thus 


for , 


f {l-H(u)  }P(z  ,u)du=[A(z  ,0)-I]R"^ (z) , 0<z<l  , 

0- 


A(z,0)=/  exp[R(z)t]dH(t) 
0- 


Putting  this  in  (3.3.20)  and  simplifying  with  (3.2.6)  and 
(3.3.7)  the  expression  for  l[(z)  for  0<z<l  is  obtained. 

Now,  by  letting  z-»-l-  in  (3.3.20),  we  have 

Y(1-)  = 5*  -XqR'^  (0)  + {-21qR'^0)Q*+X(1-)}/  { 1 -H(u  ) }P  ( 1 ,u  )duj 

(3.3.21) 

It  is  now  easily  shown  that  Y^(l-)£=1.  Now, 

(0)Q*+X(1-)}/  {l-H(u)}P(l  ,u)du 
^ 0- 

= {-XqR'^  (0)Q*+e-2LQR'^  (O)Q*A(I-A+0)"^ } 

X / {l-H(u)}exp(Q*u)du  by  (3.2.8) 

0- 

= (O)n+A(I-A+0)'^]Q*/  {l-H(u)}exp(Q*u)du 

^ 0- 

using  the  commutativity  of  Q*  with  A and  0. 

= ^0+XoR’^ (O)[I+A(I-A+0)‘^][I-A] 


. i 

i 1 

I 

Substituting  this  in  (3.3.21)  and  post-multiplying  by 
Q*  it  is  easily  verified  using  £Q*=0  that 

Y(1-)Q*  = 0. 

We  already  noted  that  Now  by  the  uniqueness  of 

the  invariant  probability  vector  Y^(l-)=£. 

Remark : Note  that  the  j-th  component  of  X(l“)  is  the 
stationary  probability  that  the  phase  of  the  N-Process  is  j. 

Clearly  this  must  be  0.,  for,  £ is  the  invariant  probability 

J 

vector  of  the  Markov  Process  Q*  governing  the  phases. 

We  now  verify  the  correctness  of  (3.3.19)  by  particula- 
rizing it  to  the 

Special  Cases: 

1.  M/G/1  queue  (with  single  arrivals);  Noting  that  in  this 

i 

case  5*=x  and  R(z)=x(z-1),  (3.3.19)  reduces  to  Y(z)=X(z).  | 

Also,  after  some  tedious  computations  using  (3.2.6)  we  can  I 

obtain  i 

Y(z)=X(z)=(l-p)(l-z)H(x-Xz)/{H(x-xz)-z}  ' 

j 

2.  M/G/1  queue  (with  group  arrivals):  In  this  case  after 
some  tedious  computations  one  gets 

Y(z)  = (l-p)H(x-X<^(z))+.pJ^  X(z){l-H(X-Xi.(z))}, 
for,  in  this  case 

yo=(l-p)»  Xq=(1-p)/ti,  U(z,0)  = (^(z),  -R"^(0)  = 1/X 


where  (|i(z)  is  the  p.g.f.  of  the  group  size  and  n='l''(l-). 
The  expression  for  Y(z)  given  here  coincides  with  that 
obtained  earlier  by  Neuts  [19]. 
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CHAPTER  IV 


MOMENTS  OF  THE  QUEUE  LENGTH 


4.1  Introduction 

It  was  pointed  out  earlier  that  the  first  two  moments 
of  the  queue  length  can  be  used  to  truncate  the  infinite 
system  of  equations 

xQ(“>)=x.,  xe=1 

defining  the  stationary  probability  vector  x.  While  it 
would  be  ideal  to  have  efficient  methods  for  optimally  trun- 

i ; 

eating  the  system  above,  nevertheless,  the  problem  of 

i: 

obtaining  suitable  criteria  for  this  purpose  appear  quite  : 

intractable,  and  in  the  absence  of  such  methods  one  has  to  I 

I ^ 

rely  on  some  simple  procedures  such  as  using  a "y+So  limit".  j 

i . 

Fortunately,  computational  experience  reported  by  Neuts  [18]  ; 

j 

and  Lucantoni  [11]  seem  to  favor  such  a procedure.  We  shall,  | 

1. 

in  this  Chapter,  obtain  the  moments  of  the  stationary  queue  j: 

! 

length  distributions  obtained  in  Chapter  III.  j' 

The  moments  of  the  queue  length  are  closely  related  to  j 

i 

the  derivatives  of  the  Perron-Frobeni us  eigenvalue  and  I 

i 

associated  eigenvectors  of  the  matrix  A(z,0+)  as  z-^1-.  We  i 

derive  the  recurrence  relations  for  computing  these  deriva-  j: 

tives  in  Section  4.2  using  which  formulas  for  the  first  two  ; 

I 

moments  of  the  queue  length  are  derived  in  Section  4.3.  For  ji 




a semi-Markov  process  0(*)  having  a structure  more  general 
than  the  one  given  by  (1.4.1),  a program  for  computing  the 
' vector  21  ^nd  its  first  two  moments  using  similar  techniques 

has  been  written  in  APL  by  David  Lucantoni  [11]  and  is  seen 
to  be  very  efficient.  We  refer  the  reader  to  [11]  for 
\ details  of  this  program. 

I 4.2  Derivatives  of  the  Perron-Frobeni us  Eigenvalue 

Just  as  in  Theorem  2.2.8  which  establishes  the  irreduci- 
; bility  of  A,  we  can  show  that  the  nonnegative  matrix  A(z,0) 

for  0<z<l  is  irreducible.  We  let  n(z)  denote  the  uniquely 
defined  Perron-Frobeni us  eigenvalue  of  A(z,0)  which  is 
analytic  for  z<l . Let  u_(z)  and  y^(z)  be  the  right  and  left 
eigenvectors  respectively  of  A(z,0)  corresponding  to  the 
eigenvalue  n(z),  whose  components  are  defined  to  be  analytic 
for  z<l  and  such  that 


v(z)u^(z)=^(z)e=l  (4.2.1) 

v(l-)=£,  u(l-)=e  (4.2.2) 

hold,  in  addition  to  the  defining  equations 

[A(z.0)-n(z)I]u(z)=0  (4.2.3) 

v(z)[A(z,0)-n(z)I]=0.  (4.2.4) 


Below  we  present  a theorem  which  shows  how  the  derivatives 
n^'^^(l-)9  u^^'^^(l-)  and  v^'^^(l-)  can  be  evaluated  recursively 
on  n,  provided  that  moments  of  a sufficiently  large  order 


z = l- 


r 


Theorem  4.2.5;  The  triples  £^'^^(1-)  and 

n>0  may  be  computed  recursively  for  each  n for  which  the 
matrix  A'  '(1,0)  is  finite.  The  recursion  formulas  are 


n^°^l-)  = l.  u^°^l-)  = e,  /°^l-)  = 0 
n^^^l-)  = P,  u^^^l-)  = (l-A+0)"V-pe, 

v^^^l-)=iA^^^(l  ,0)(I-A+e)‘^-pe 


(4.2.6) 


(4.2.7) 


and  for  n>2. 


,(n)/i_\,  !il  /n\„A(v) 


Ti'"'(l-)=  I (")eA"'Ml.0)u'''-"^(l-)-  s n'"'(l-)0u 


(n-v) 


(n-v) 


(4.2.8) 


v^"^1-)=  Z ('’)v^''^(l-){A^'^’''^l  ,O)-n^""''^l-)I}(I-A+0)‘^ 
v=0 


(4.2.9) 


u('’)(l-)  = (I-A+0)’‘'|^  Z^  (|;){A^''^1  .0)-n^'’^l-)I}u^"‘''^1-)j 


\ ([')v^'')(1_)u('^‘'')(l-)e  (4.2.10) 


Proof:  Differentiating  (4.2.3)  n times  with  respect  to  z we 


" (;;)[A(''^z.0)-n^''^z)I]u('’''’^z)  = 0. 


Pre-mul tiplyi ng  this  equation  by  v^(z)  and  letting  z->1  - yields 
in  view  of  (4.2.2) , 

" (")[eA^''^l,O)-n^''^1-)0]u^"‘''^l-)  = O 
v=0 

from  which  we  have 


V=1  ''  v==1 

(4.2.11 ) 

which  is  finite  if  A^'^^(1,0)  is  finite.  In  the  case  n = l the 
second  term  in  (4.2.11)  is  zero  and  the  first  term  equals 
^A^ ^ ^ ( 1 ,0)e=03=p  showing  n^^^(l-)  = p. 

Differentiating  (4.2.4)  once  and  letting  z->-l-  we  get 

v(1)(l-)[i-A]=e[A(l^l,0)-n^^^l-)I] 

or 

^l-)=i[A(^^(l  .O)-n^^^l-)I](I-A+0)'’'+v^^^l-)e 
=iA^^  ^1 ,0)(I-A+0)'^-p0, 

for,  the  second  equality  in  (4.2.1)  implies  ^^^^(l-)e=0 
whence  ^ (1-)0=O. 

In  general,  differentiating  (4.2.4)  n times  yields 

after  letting  z-»-l-, 

n 1 

v^"^(l-)[I-A]=  Z (")v^''^l-)[A^"’''^l  ,0)-Ti^"‘''^l-)I]. 

v=0  ''  “ 

Adding  ^^'^^(l-)0  to  both  sides  and  noting  that  y^^”^(l-)0=O 
because  of  the  second  equality  in  (4.2.1),  we  get  (4.2.9). 
Differentiating  (4.2.3)  n times  we  get  after  letting 

z-^-1-, 

(I-A)u^"^(l-)=  " (")[A^''^1  ,0)-n^''^(1-)I]u^""'’^l-). 

— 1 ^ 
v=  1 

/ n \ 

Adding  0]j'  '(!-)  to  both  sides  we  can  rewrite  the  above 


equation  as 


v=l  '' 

+ [eu^'’Ul-)]e  (4.2.12) 

Differentiating  v{z)ii(z)=l  n times  and  letting  z^l-  we  get 
eu^»i)(l.)  = . " (")v^''^l-)u^"'''^l-) 

_ 1 V 
V=1 

= (4.2.13) 

v=l 

for,  ]/(z)£=l  implies  (l-)e=0.  Using  (4.2.13)  in 

(4.2.12)  we  get  (4.2.10).  In  the  case  n=l,  the  sum  in 

(4.2.13)  is  zero  and 

u(1)(1-)=(I.A+0)-''[a(^  )(1  ,0)-n^’^(l-)I]u^°^l-) 

= (I-A+0)  ^ [£-pe^]=  ( I -A+0 ) ^£-pe, 
and  the  proof  is  complete. 

4.3  Moments  of  the  Queue  Length 

In  this  section  we  derive  the  first  two  moments  of  the 
queue  length  in  terms  of  the  derivatives  obtained  in 
Theorem  4.2.5.  We  wish  to  derive  formulas  for  computin'’ 
^'(l-)e  and  )^"(l-)£.  To  this  end  let  us  recall  the  equation 
(3.2.6) 

X(z)[zI-A(z,0)]=Xo[U(z.O)-I]A(z.O) 

Multiplying  this  by  u^(z)  we  get 

[z-n(z)]X(z)u(z)=n(z)xQ[U(z,0)-I]u(z) 


(4.3.1) 


Differentiating  this  with  respect  to  z and  rearranging 
X' (z)u(z)  = -X(2)u'  (z)  + 

z-ndrlj^^'^'  (z)  )X(z)u(z)+n  ' (z)xq{U(z,0)-I}u(z)  + 

n(2)xQU' (z.0)u(z)+n(z)Xo(U(z,0)-I}u' (z)j  (4.3.2) 

Now , as  z->l - , 

- ( 1 -n  ■ ( z ) ) X ( z ) u { z )->-  ( 1 -p ) X ( 1 - )e=-  ( 1 -p  ) 
n'  (z)Xq{U(z,0)-I}u(z)-vpXq{U(1  ,0)-I}e=0 
n(z)xQU' (z,0)u(z)->-XqR"^  (O)R' (1  )e  using  (2.2.5) 

and 

n(z)xQ{U(z,0)-I}u'  (z)-^- 

XqC'R'^ (O)R(l  )][(I-A+0)' V"pe]  using  (2.2.5)  and  (4.2.7) 

=-AoR'^(O)(I-A+0)‘^(T+T°A°)0,  for  R(1)=T+T°A°  and  R(l)e=0. 

= -XQR'Uo)(I-/\+e)'h(/\-l-o)fi‘  (Ve+eR'  (l)e]  by  (3.3.4) 

Putting  all  these  together,  it  is  seen  that  as  z-*-l-  the  term 
in  square  brackets  in  (4.3.2)  converges  to 

-(l-p)-XQR"^(O)0R'(l)e=O  (4.3.3) 

by  (3.3.5). 

Thus  to  evaluate  the  limit  of  ^'(z)u(z)  in  (4.3.2)  as  Z-+-1-, 
we  apply  L'Hospital's  rule  on  the  second  term  in  the  right 
side  of  (4.3.2).  After  some  tedious  computations  it  may  be 
verified  that  this  yields 


X'(l-)e=-X(1)u’(l-)+ 


" ( 1 - ) +2p2LoU '•  ( 1 .0 ) e+2pXo{U  ( 1 .0 ) - 1 }u  ' C 1 - ) 

+2xoU' (1  ,0)u' (l-)+XoU"(l  ,0)e+5^{U(l  ,0)-I}u"(l-)J  (4.3.4) 


Now , 


U(z,0)=I-R"'(0)R(z) 


implies 

2pXq[U' (l,0)e+{U(1  .0)-I}u'(l-)]  = 

-2px«R‘^(0)R'  (l)e+2p2in{'R'^  (0)  ( I-A+g)"^  (T+T°A°  )b}  by 

- -0  - (4.2.7) 

= -2p2iQR"^(O)R'(l)e+2pXQ{-R'^(O)}[-R'(l)e+0R'(l)e]  by 

(3.3.4) 

= -2p2iQR‘^  (O)0R'  (1  )e 

=2p(l-p)  by  (3.3.5) 

Using  this  in  (4.3.4)  we  simplify  the  expression  for  ^'(l-)£ 
and  state  the  result  as 

Theorem  4.3.5:  The  stationary  expected  queue  length  immed- 
iately after  a departure  is  given  by 

X'  (l-)e=-X(l-)u' (l-)+p  + 

2(T-p-)[^"(^-)^^Xo^'n  .0)u'(l-)+XoU"(l,0)e+ 

Xq{U(1  ,0)-I}u"(l-^  (4.3.6) 


The  correctness  of  (4.3.6)  is  verified  by  particularizing  to 


mmmmmmmmmsrn 


Special  Cases: 

a)  M/G/1  queue:  Here  U(z,0)  = z,  u.(z)  = l.  So,  (4.3.6)  re- 

1 2(2) 

duces  to  X'  n~)~P^2(1-p)'  ^ ’ where  X is  the  arrival  rate, 

and  is  the  second  (raw)  moment  of  H(*). 

b)  M/G/1  queue  with  group  arrivals;  Here  U(z  ,0)  = <|>(z) , 
where  <|)(z)  is  the  p.g.f.  of  the  group  size,  and  u(z)  = l.  So 
we  can  easily  verify  that 

X’(l-)=P+g(]-py[n”(i-)+Xo^“(l-)]. 

Now 

n"(1-)=A"(1.0)  = A%(2)^^.p_jj2^_^p^  ^"(l-), 

since 

A(z,0)  = ; dH(t). 

fl- 
it has  already  been  shown  that  Xq=  ( 1 -p )/(j) ' ( 1 - ) whence  we 
have 

Theorem  4.3.7: 

X'  (1-)  = [XqU'  (1  ,fl)A+x^{U(l  ,fl)-I}A'  (1  ,fl)-X(l){I-A'  (1  ,fl)}](I-A  + 0)‘'' 
+(X'(l-)e)e 

Proof:  Differentiating  (4.3.1)  with  respect  to  z and  letting 
z->l-  we  get 

X'  (1-)[I-A]=2{qU'(1  ,0)A+Xq{U(1  ,fl)-I}A'(l  ,0)-X(l){I-A'(l  ,0)}. 

Adding  ^'(1-)0  to  both  sides  and  simplifying  we  get  the 
expression  for  ^'(1-)  given  above. 


We  also  obtain  a formula  for  the  stationary  mean  queue 
length  in  continuous  time. 

Theorem  4.3.8:  The  stationary  mean  queue  length  in  contin- 
uous time  is  given  by 

Y'(1-)e=p{X'  (l-)e-XQR'^(0)R'  (l)e}+J-C*^v^^^ 

-C*{-XoR'’  (0)Q*+X(1-)}{I-A+u^^  ^Q*}(t*0-Q*)‘^R'  (1  )e, 

I 

(4.3.9) 

where  t*  is  any  real  number  such  that 


T*>max(-QT . ) . 

~ i ' ’ 

Proof:  Differentiating  (3.3.19)  with  respect  to  z,  letting 
z->-l-  and  post-multiplying  by  £ we  get 

Y' (1-)e=5*[xoU' (1 .0)+X'(1-)]u(^^e  + 

C*[xn{U(1 ,0)-I}+X(1-)]7  {1-H(t)}c(t)dt 
^ 0- 

= p{X' (1-)e-XQR‘^0)R' (1  )e}  + 

5*[-XnR‘^0)Q*+X(l-)]7  {1-H(t)}  0R'(l)et  + 

^ 0-  L “ 


{I-e^*^}{T*0-Q*}'^R' (1 )e  dt 

w 


where  t*  is  any  real  number  such  that  T*>max(-QT.) 

” i ^ ^ 


(4.3.10) 
by  (1.3.13) 


Now 


{ I-e^*^}(T*0-Q*)  = T*0-T*0-Q*{I-e^*^} , 

for , 


whence 


{i-e^*^}(T*0-q*)"^=-q*{l-e^*^)(T*0-q*)'^ 

Thus 

; {l-H(t)}{I-e‘^*^}{T*0-q*}"^R'  (1  )edt 
0- 

=-/  {l-H(t)}q*{I-e^*^}dt{T*0-q*}'^R' (1  )e 

0- 

=.[p(l)q*+(I-A)][T*0-q*]‘^R' (l)e.  (4.3.11) 

for , 

I {l-H(t)}q*e^*^dt=A-I 
0- 

as  can  be  seen  by  integration  by  parts  and  (2.2.9). 

Putting  (4.3.11)  in  (4.3.10)  we  get  (4.3.9). 

We  now  verify  the  correctness  of  (4.3.9)  by  particular- 
izing to  the 


Special  cases: 

a)  M/G/1  queue:  In  this  case  (4.3.9)  reduces  to 

Y'  (l)  = p{(p  + g(-]-^  x2u^^^)  + (1-p)}+y(-^)^^^^ 

_ . 1 .2  (2)_vi/i\ 

as  is  well-known. 

b)  M/G/1  queue  with  group  arrivals:  Here  (4.3.9)  reduces  to 

2 

Y'(l)  = p{X'(l)-XQ(-i)X^'(l-)}4(^) 


-.1  1 (2),  ,,,  V 2 1 d."{io  1 

^ ^ *zrr^  ^JTT  "2  Mir 

_y,(.  X 1 r'(i-) 


We  are  now  ready  to  obtain  the  second  (factorial) 
moment  of  x.  We  state  our  result  as 


Theorem  4.3.12; 

X’'(l-)e=-2X'  (l-)u'  (l-)-X(l-)u"(l-)  + n"(l-)-2p^ 


+ 


1 

3(l-p) 


n'"(l-)  + {3n"(l-)+6p(l-p)}{X’  (l-)e+X{l  )u'  (1-)} 


-3pn"(l-)+XoU'"(l-.0)e+3xQU"(l-.0)u'(l-) 

+ 3XqU'  (l-.0)u"(l-)  + Xo{U(l  ,0)-I}u"'(l-)j  (4.3.13) 

Proof : Differentiating  (4.3.2)  twice  with  respect  to  z and 
rearranging  the  terms  we  get 

X"(z)u(z)=-2X’ (z)u(z)-X(z)u"(z) 


-2{l-n'(z)}X'(z)u(z)-2{l-n' (2)}X(z)u'(z)+ 


(z-n(z)) 

n"  (z)2^(z)ii(z)  + n"(z)xQ{U(z  ,0)-I  }£(z)+2n  ' (z)xqU  ' (z  ,0)u^(z) 
+ 2n'  (z)xq{U(z,0)-I}i['  ( z )+n  ( z )XqU"  ( z ,0)u_(z  ) + 

2n(z)xQU' (z,0)u' (z)+n(z)xQ{U(z,0)-I}u"(z)j 


(4.3.14) 


r 


Now  as  z->l-,  the  quantity  in  square  brackets  above  converges 
to 

-2(l-p)X'(l-)e-2(l-p)X(l-)u'(l-)+n"(l-)+2pXQU'(l  ,0)e+ 
2pXq{U(1  .0)-I}u’(1-)+2<qU"(1  .0)e+22LQU'(1  ,0)u'(l-)  + 

Xq{U(1  .0)-I}u"(l-) 

=-2(l-p)X' (l-)e-2(l-p)X(l-)u'(l-)+n"(l-)+2p(l-p) 

+XqU"(1  ,0)e+2xQU'  (1  ,0)u'  (1-)+)1q{U(1  ,0)-I}u"(l-) 

=0  (4.3.15) 

where  the  last  equality  above  is  got  by  substituting  the 
value  of  ^'(l-)e  from  (4.3.6)  and  the  one  before  that  is 
got  by  using  (4.3.3)  which  implies 

XqU'  (1  ,0)e+2(Q{U(l  ,0)-I}u'  (l-)  = (l-p).  (4.3.16) 

Thus  to  evaluate  the  limit  as  z-»-l-  of  (4.3.14)  we  can  apply 
L'Hospital's  Rule  on  the  third  term  in  the  right  side  of 
(4.3.14).  After  some  gruesome  computations  we  get 

X"(l-)e=-2X'(l-)u'(l-)-X(l-)u"(l-)+ 

j^47^[^3n"(l-)X'(l-)e+3n"(l-)X(l-)u'(l-)+n"‘(l-) 

+ 3n"(l-)xoU' (1  .0)e+3n"(l-)xotU(l  ,0)-I}u'(l-) 

+ 3pXoU"(1  ,0)e+6px^U' (1  ,0)u' (l-)+3pXo{U(l  ,0)-I}u"(l-) 

+XqU‘"(1  ,0)e+3xQU"(l  ,0)u'  (l-)  + 3x^U'  (1  ,0)u"(l-) 

+Xo{U(l  ,0)-I}u"'(l-)'l 


PT 


=-2X' (l-)u' (l-)-X(l-)u"(l-)+ 

3^j7jy|^r,"'(l-)  + 3n''(1-){X'(l-)e+X(l)u'(l-)  + (l-p)} 
+3p{2(l-p)X'(l-)e+2(l-p)X(l-)u'(l-)-n"(l-)-2p(l-p)} 
+XoU"‘(l  .0)e+3xQU"(l  .0)u'  (1-)+3XqU'  (1  ,0)u"(l-) 

+2<q{U(1  ,0)-I}u'"(l-)J  by  using  (4.3.16). 

Now  (4.3.13)  is  got  by  using  (4.3.15)  in  the  above  equation. 

Remarks : 

1.  As  pointed  out  earlier  the  formulas  (4.3.6)  and  (4.3.13), 
in  spite  of  their  forbidding  forms,  are  well-suited  to 
numerical  computations. 

2.  Higher  moments  of  the  queue  length  can,  in  principle,  be 
found  using  similar  techniques.  But  the  resulting  formulas 
become  extremely  difficult  to  implement.  Usually,  however, 
these  are  beyond  the  realm  of  practical  interest. 


CHAPTER  V 


THE  VIRTUAL  WAITING  TIME 

5.1  Introduction 

The  virtual  waiting  time  V(t)  at  time  t is  the  length  of 
time  a customer  who  arrives  at  time  t waits  before  entering 
service.  Recall  that  J(t)  is  the  phase  of  the  arrival  process 
at  t+.  In  this  Chapter  we  derive  the  joint  distribution  of 
V(t)  and  J(t)  as  t->«.  To  this  end  it  shall  be  assumed  that 
the  arriving  groups  are  served  on  a f i rst-come-f i rst-served 
basis;  we  shall  not  assume  anything  regarding  the  order  of 
service  within  each  group. 

The  formula  for  the  steady-state  Lapl ace-Stiel tjes 
transform  of  V(t)  generalizes  the  well-known  Pollaczek- 
Khinchin  formula  of  the  M/G/1  queue  to  the  N/G/1  queue.  It 
is  also  shown  that  the  steady-state  c.d.f.  of  V(t)  satisfies 
a Volterra  system  of  integral  equations.  It  is  well-known 
that  such  a system  can  be  solved  numerically  with  considerable 
ease  using  classical  methods. 

5.2  Distribution  of  the  Virtual  Waiting  Time 
Let 

j 

W.(x)  = Lim  P[V(t)<x ,J(t)=j I X(0)  = i ,J(0)=j ' ] , x>0,  l<j<m 
J t->«  " - - - 


J. 


The  Laplace-Stieltje's  transform 
00 

W.(s)=/  dW.(x),  Re  s>0. 

J 0- 

We  also  let  W ( • ) and  W ( • ) denote  the  m-vectors  whose  j-th 
components  are  W j ( • ) and  W j ( • ) respectively.  Also  will 

denote  the  v-fold  convolution  of  H with  itself. 


Theorem  5.2.1 


W(s)  = 


sy^{sI+R[H(s)]}"'  if  s>0 


(5.2.2) 


if  s=0 


Remark : Formula  (5.2.2)  is  a direct  generalization  of  the 
Pol  1 aczek-Khi nchi n formula  to  the  N/G/1  model. 


Proof:  By  a direct  probabilistic  argument  considering  the 
last  departure  epoch  t before  t we  obtain 


P[0<V(t)<x,J(t)=j|X(0)=i.J(0)=j']= 


m t 


t Z 1 dR,'’i.(T)  Z Pn(v,,t-T)  ! dH(t*w-i)H  ' ‘(x-w) 

, = i k=i  T=o-  '’r  vo=o  ^ w=o- 


m t 


t-T  <»  m 


+ z / dR'J  (t)  / EE  [dU^,  (u)]  E P_  .(vp,t-T-u) 

k = i T=0-  u = 0-  v^  = l p=l  ''l  kp  V2  = 0 PJ 

X . .(vi+vp-1) 

/ dH(t+w-T-u)  H (x-w) 

w=0- 


The  two  terms  above  on  the  right  side  correspond  respectively 
to  the  two  cases  di agramatical ly  shown  below. 


Case  1 : 


X(T)=V^gl 

J(T)=k 


Figure  1 


J(t)=j 


at  least  v^+v2-1  depart 


no 

arrivals 


service  time 


Letting  t-*-*  in  the  above  equation  and  using  the  Key-Renewal 
Theorem  (Theorem  6.3,  p.l53,  pillar  [2]),  we  get 


Lim  P[0<V(t)<x,J(t)  = j |X(0)  = i ,J(0)=j '] 
t->-» 


oo  m * 


Ilf  x(v,,k)dt  z PuCvp.t)  / dH(t+w)H 
1^  = 1 k=l  t=0-  v_  = 0 ^ w=0- 


(v,+v,-l ) 


(x-w) 


m « t 00  m 

+5*  I f x(0,k)dt  / z z [dU  (t-y)] 

k=l  t=0-  y=0-  v,  = l 0=1  ''1 


/ E z [dU  (t-y)]  z P_.(vp,y)dy 
y=0-  v^  = l p=l  ''1  kp  V2  = 0 PJ  ^ 


X . ,(v,+V2-l) 

/ dH(y+w)H  ' ^ 

w=0- 


(x-w) 


whence , 


W(x)-JiQ= 


(V1+V2-1) 


E / X E P(v~,t)dt  / dH{t+w)H  (x-w)+ 

v^  = l t=0-  '’1  V2  = 0 ^ w=0- 

00  ^ 00  00 

Xn  / dt  / E [dU  (t-y)]  E P(v«,y)dy  / dH(y+w) 

u t=0-  y=0-  v^  = l ''l  V2  = 0 w=0- 


C*Xn  / dt  / 
u t=0-  y=0-  V 

. ( V,+Vp-1 ) 

H ' ^ (x-w). 


W(0)=)^, 


Thus , 


W(s)=yn+s;  e"^^{W(x)-W(0)}dx 
^ 0+ 


EX  f e'^’^dx  / E P(vo,t)dt  f dH(t+w) 
^ = x=0+  t=0-  V2=0  w=0- 

.(V,+Vp-1 ) 

II  I C / ..  . . \ 


(x-w) 


00  00 


+ sc*Xf,  E U^,  / e’^^'^dx  / E p(v,,t)dt  f dH(t+w) 


v^  = l n x=0+  t = 0-  V2  = 0 

. ( v,+v«- 1 ) 

H ' ^ (x-w) 


00  00  00 


w=0- 


-«tw  - v,+Vj,-l 

SW  j ij  / ^ \ u * t 


=y.n+5*  EX//  P(v9.t)dte"'**'dH{t+w)H 

^ v^  = l ''l  t=0-  w=0-  V2=0 


00  00  00 


+ C*Xn  S u / / E P(v5,t)dte'  *'dH(t+w)H 

" v^  = l '^1  t=0-  w=0-  V2=0  ^ 

which  on  noting 

00 

E P(v,t)z'’=exp{R(z)t} 
v=0 

yields 


Vi +V2“1 


00  00  00 

W(s)=;^„+5*  L X f f exp{R[H{s)]t}‘dte"^'^dH(t+w)H 

U y=l  V 

00  oo  oo  . 

+ C*Xn  rU  / / exp{R[H(s)]t}-dte“^'^dH(t+w)H'''' 

^ v=l  t=0-  w=0- 


v-1 


(s) 


(s) 

(5.2.3) 


Now , 


f exp{ (sI+R[H(s)])t} •dt={exp(sI+R[H(s)])w-I}{sI+R[H(s)]}"^ 
0- 


Since  the  integral  on  the  left  side  of  the  above  equation  is 
analytic  in  Re  s>0,  the  right  side  has  only  removable  sing- 
ularities at  a finite  number  of  points  in  Re  s>0,  where  the 
inverse  fails  to  exist.  Thus 


00  00 

/ exp{R[H(s)]t}dt  / e"^”dH(t+w) 

t=0-  w=0- 

00  oo 

= / exp[{sI+R[H(s)]}t]-dt  / e‘^^dH(y) 

t=0-  y=t- 

= 1^/  exp{R[H(s)]w}*dH(w)-H(s)lJ(sI+R[H(s)])"^ 


Using  this  in  (5.2.3),  for  s>0, 

W(s)=y:o+?*(21o  ^ U^H'’"''(s)+  I x H'’■^s)). 

V V=1  V=1  ^ 

I / exp{R[H(s)]w}-dH(w)-H(s)I  (sI+R[H(s)])"^ 

Lw=0-  J 

( H ( s ) , 0 ) + X ( H ( s ) ) -Xq]  • 

[A(H(s).0)-H(s)I](sI+R[H(s)])''' 

=Zo+5%R'^(0)R[H(s)](sI  + R[H(s)])'^ 

as  can  be  seen  by  using  (3.2.6)  and  (2.2.5).  (5.2.2)  now 

follows  for  s>0  from  (3.3.7). 


Multiplying  both  sides  of  (5.2.2)  by  sI+R[H(s)], 


W(s){sI+R[H(s)]}  = S)^q. 

Letting  s+0,  we  get  W(0+)Q*=0.  So  to  show  that  W(0+)=£  It 
now  suffices  to  prove  that  W(0+)e=l.  To  this  end  multiply 
(5.2.3)  by  e and  let  s+0  to  get 

CD  00  DO 

W(0+)e=(y^e)+L1m  c*  2 (j^  e)  / dt  / e”^'*'dH ( t+w) 

^ s + 0 v=l  t=0-  w=0- 

00  00 

+L1m  C*21n®  f dt  f e"^'^dH(t+w) , 

s+0  t=0-  w=0- 

for , 

exp(Q*t) ‘BEe 
and 

00 

z U e=e. 

_ 1 V—  — 

v=  1 

Thus 

00  CO 

W(0+)e=(l-p)  + c*L1m  / dt  / e'^'^dH(t+w)  by  (3.3.11) 

S4-0  t=0-  w=0- 

= (l-p)  + C*P^^  ^ 

= ( 1 -p  )+p  = l , 

and  the  proof  Is  complete. 


Remark : Note  that  for  the  M/G/1  queue,  (5.2.2)  reduces  to 
the  well-known  Pol  1 aczek-KhInchIn  Formula 


s>0 , 


for.  In  this  case  yQ=(l~p)  and  R(z)=-x+xz, 


Theorem  5.2.4:  The  vector  W(x)  satisfies  the  Voiterra  system 
of  integral  equations 


W(x)=y;Q+fi*K(x) , x>0 


where , 


(5.2.5) 


K(x)=/  A(x)A(e-  2:  £(k)H^'^^(y)) 

OL  k=0 

-To  E q(k)H^'^^y)-T“A°o  Z r ( k ) H ^ ^y ) j dy  , x>0 

k=0  k=0  J 

Proof:  From  (5.2.2)  it  is  seen  that  for  s>0, 

W(s){sI+R[H(s)]}=syQ 

or 

W(s)=y.Q+W(s){-i  R[H(s)]}  . 


-J  R[H(s)]=l[A(x){I-A(i(H(s)))}-7o<<>(H(s))-T‘’A°o»(H(s))], 

which  shows  that  -j  R[H(s)]  is  the  Laplace-Stiel tjes 
transform  of  K(*)  given  in  (5.2.6).  Hence  the  Theorem. 


(5.2.6) 
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We  discuss  a single  server  queue^whose  input  is  the  versatile 
Markovi 
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to  be  called  the  N-Process.  Special  cases  of  the  N-Process  d i sea»e4 
>-eerHer  -Hv-the  1-Ueratu«i»  include  a number  of  complex  models  such 
as  the  Markov-modulated  Poisson  Process,  the  superposition  of  a 
Poisson  Process  and  a Phase  Type  Renewal  Process  etc.  This  queueing^ 


Q I scuss  a single  server  queue^wiiudc  iii^uu  i9  liic  vci  301,1  ic; 

'ian  point  DrocesSfyecent 1 v introduced  by  M.F,  Neuts  (c.f . Tech 
#77/13,  Dept,  of  Statistics  6 CS,  CTnlv.  of  Delaware)  here  in 
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model  has  great  appeal  in  its  applicability  to  real  world  situations 
especially  such  as  those  involving  inhibition  or  stimulation  of 
arrivals  by  certain  renewals.  The  paper  presents  formulas  in  forms 
which,  are  computationally  tractable  and  provides  a unified  treatment 


of  many  mc^el s^which  were  discussed  earlier  by  several  authors  and 
<$which  turn  out  to  be  special  cases.  Among  the  topics  discussed  are 


busy  period  characteristics,  queue  length  distributions,  moments 


of  the  queue  length  and  virtual  waiting  time.  The  anaiysis  presented 


here  serves  as  an  example  of  the  power  of  Markov  Renewal  Theory. 


